2026-03-28 05:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 05:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 05:30:06 [auto1.de] INFO: Batch mode enabled: batch 1/2
2026-03-28 05:30:06 [auto1.de] INFO: Starting spider auto1.de
2026-03-28 05:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 05:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 05:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 05:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 05:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: bface668850a3388
2026-03-28 05:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 05:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_17_2026-03-28T05_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 05:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 05:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 05:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 05:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 05:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 05:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 05:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 05:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-28 05:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 05:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 05:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 05:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 05:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 05:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 05:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 05:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 05:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 05:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 05:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-28 05:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 05:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 05:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 05:30:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 05:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 05:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 05:30:16 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 9199 | hits on page: 40
2026-03-28 05:30:16 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-28 05:30:16 [auto1.de] INFO: Found listing with ID: SR82375
2026-03-28 05:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR82375%27 HTTP/1.1" 200 None
2026-03-28 05:30:16 [auto1.de] INFO: Scrape type for SR82375: 2
2026-03-28 05:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80a6a6d2-8866-5720-9f42-3a1f3a8e66b7 with identifier: SR82375
2026-03-28 05:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80a6a6d2-8866-5720-9f42-3a1f3a8e66b7 with scrape type 2
2026-03-28 05:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80a6a6d2-8866-5720-9f42-3a1f3a8e66b7 with scrape type 2
2026-03-28 05:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80a6a6d2-8866-5720-9f42-3a1f3a8e66b7, identifier: SR82375
2026-03-28 05:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80a6a6d2-8866-5720-9f42-3a1f3a8e66b7 with identifier: SR82375
2026-03-28 05:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 05:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 05:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80a6a6d2-8866-5720-9f42-3a1f3a8e66b7 with identifier: SR82375
2026-03-28 05:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80a6a6d2-8866-5720-9f42-3a1f3a8e66b7 with identifier: SR82375 to the API
2026-03-28 05:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:45:51Z',
 'fuel_type': 'electro',
 'id': '80a6a6d2-8866-5720-9f42-3a1f3a8e66b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR82375',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 26636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 107 kW Pro',
 'transmission': 'automatic',
 'trim': 'Pro',
 'year': 2022}
2026-03-28 05:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR82375%27 HTTP/1.1" 200 None
2026-03-28 05:30:17 [auto1.de] INFO: Saving data for SR82375: {'auction_closing_time': 1774716351.0, 'created_time': 1774550744.47669, 'last_price_update_time': 1774675817.85765}
2026-03-28 05:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR82375') HTTP/1.1" 204 0
2026-03-28 05:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:17 [auto1.de] INFO: Found listing with ID: FH90697
2026-03-28 05:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH90697%27 HTTP/1.1" 200 None
2026-03-28 05:30:17 [auto1.de] INFO: Scrape type for FH90697: 2
2026-03-28 05:30:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95eb23fa-9bfc-5136-9f83-d525ed745933 with identifier: FH90697
2026-03-28 05:30:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95eb23fa-9bfc-5136-9f83-d525ed745933 with scrape type 2
2026-03-28 05:30:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95eb23fa-9bfc-5136-9f83-d525ed745933 with scrape type 2
2026-03-28 05:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95eb23fa-9bfc-5136-9f83-d525ed745933, identifier: FH90697
2026-03-28 05:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95eb23fa-9bfc-5136-9f83-d525ed745933 with identifier: FH90697
2026-03-28 05:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 05:30:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95eb23fa-9bfc-5136-9f83-d525ed745933 with identifier: FH90697
2026-03-28 05:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95eb23fa-9bfc-5136-9f83-d525ed745933 with identifier: FH90697 to the API
2026-03-28 05:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:01:54Z',
 'fuel_type': 'electro',
 'id': '95eb23fa-9bfc-5136-9f83-d525ed745933',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH90697',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.4',
 'odometer': 62592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-04',
 'seller_name': None,
 'title': 'Volkswagen ID.4 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2022}
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH90697%27 HTTP/1.1" 200 None
2026-03-28 05:30:19 [auto1.de] INFO: Saving data for FH90697: {'auction_closing_time': 1774713714.0, 'created_time': 1774550709.633293, 'last_price_update_time': 1774675819.05353}
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH90697') HTTP/1.1" 204 0
2026-03-28 05:30:19 [auto1.de] INFO: Found listing with ID: YV38391
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV38391%27 HTTP/1.1" 200 None
2026-03-28 05:30:19 [auto1.de] INFO: Scrape type for YV38391: 2
2026-03-28 05:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f14cec2e-a841-5b3b-8d95-ef65ee61521b with identifier: YV38391
2026-03-28 05:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f14cec2e-a841-5b3b-8d95-ef65ee61521b with scrape type 2
2026-03-28 05:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f14cec2e-a841-5b3b-8d95-ef65ee61521b with scrape type 2
2026-03-28 05:30:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f14cec2e-a841-5b3b-8d95-ef65ee61521b, identifier: YV38391
2026-03-28 05:30:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f14cec2e-a841-5b3b-8d95-ef65ee61521b with identifier: YV38391
2026-03-28 05:30:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f14cec2e-a841-5b3b-8d95-ef65ee61521b with identifier: YV38391
2026-03-28 05:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f14cec2e-a841-5b3b-8d95-ef65ee61521b with identifier: YV38391 to the API
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:42:36Z',
 'fuel_type': 'electro',
 'id': 'f14cec2e-a841-5b3b-8d95-ef65ee61521b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV38391',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 72632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Pro S',
 'transmission': 'automatic',
 'trim': 'Pro S',
 'year': 2023}
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV38391%27 HTTP/1.1" 200 None
2026-03-28 05:30:19 [auto1.de] INFO: Saving data for YV38391: {'auction_closing_time': 1774716156.0, 'created_time': 1774550758.149106, 'last_price_update_time': 1774675819.66753}
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV38391') HTTP/1.1" 204 0
2026-03-28 05:30:19 [auto1.de] INFO: Found listing with ID: WB33854
2026-03-28 05:30:19 [auto1.de] INFO: Found listing with ID: XE46726
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE46726%27 HTTP/1.1" 200 None
2026-03-28 05:30:19 [auto1.de] INFO: Scrape type for XE46726: 2
2026-03-28 05:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 688817a6-1c95-5b07-ba5c-be683ed53e82 with identifier: XE46726
2026-03-28 05:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 688817a6-1c95-5b07-ba5c-be683ed53e82 with scrape type 2
2026-03-28 05:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 688817a6-1c95-5b07-ba5c-be683ed53e82 with scrape type 2
2026-03-28 05:30:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 688817a6-1c95-5b07-ba5c-be683ed53e82, identifier: XE46726
2026-03-28 05:30:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 688817a6-1c95-5b07-ba5c-be683ed53e82 with identifier: XE46726
2026-03-28 05:30:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 688817a6-1c95-5b07-ba5c-be683ed53e82 with identifier: XE46726
2026-03-28 05:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 688817a6-1c95-5b07-ba5c-be683ed53e82 with identifier: XE46726 to the API
2026-03-28 05:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:19:21Z',
 'fuel_type': 'electro',
 'id': '688817a6-1c95-5b07-ba5c-be683ed53e82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE46726',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 65344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2022}
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE46726%27 HTTP/1.1" 200 None
2026-03-28 05:30:20 [auto1.de] INFO: Saving data for XE46726: {'auction_closing_time': 1774714761.0, 'created_time': 1774550708.22454, 'last_price_update_time': 1774675820.333055}
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE46726') HTTP/1.1" 204 0
2026-03-28 05:30:20 [auto1.de] INFO: Found listing with ID: KG17192
2026-03-28 05:30:20 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-28 05:30:20 [auto1.de] INFO: Scrape type for MT99965: 2
2026-03-28 05:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 713956ed-c174-57e8-808c-970c1b4652d0 with identifier: MT99965
2026-03-28 05:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 713956ed-c174-57e8-808c-970c1b4652d0 with scrape type 2
2026-03-28 05:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 713956ed-c174-57e8-808c-970c1b4652d0 with scrape type 2
2026-03-28 05:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 713956ed-c174-57e8-808c-970c1b4652d0, identifier: MT99965
2026-03-28 05:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 713956ed-c174-57e8-808c-970c1b4652d0 with identifier: MT99965
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 05:30:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 05:30:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 713956ed-c174-57e8-808c-970c1b4652d0 with identifier: MT99965
2026-03-28 05:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 713956ed-c174-57e8-808c-970c1b4652d0 with identifier: MT99965 to the API
2026-03-28 05:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:03:26Z',
 'fuel_type': 'diesel',
 'id': '713956ed-c174-57e8-808c-970c1b4652d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT99965',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS5',
 'odometer': 250390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-29',
 'seller_name': None,
 'title': 'Citroen DS5 2.0 HDi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2013}
2026-03-28 05:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-28 05:30:21 [auto1.de] INFO: Saving data for MT99965: {'auction_closing_time': 1774713806.0, 'created_time': 1774552740.478243, 'last_price_update_time': 1774675821.596511}
2026-03-28 05:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT99965') HTTP/1.1" 204 0
2026-03-28 05:30:21 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-28 05:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA81624%27 HTTP/1.1" 200 None
2026-03-28 05:30:21 [auto1.de] INFO: Scrape type for AA81624: 2
2026-03-28 05:30:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99000bc0-5b18-595a-aa09-80e0730a8140 with identifier: AA81624
2026-03-28 05:30:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99000bc0-5b18-595a-aa09-80e0730a8140 with scrape type 2
2026-03-28 05:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99000bc0-5b18-595a-aa09-80e0730a8140 with scrape type 2
2026-03-28 05:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99000bc0-5b18-595a-aa09-80e0730a8140, identifier: AA81624
2026-03-28 05:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99000bc0-5b18-595a-aa09-80e0730a8140 with identifier: AA81624
2026-03-28 05:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99000bc0-5b18-595a-aa09-80e0730a8140 with identifier: AA81624
2026-03-28 05:30:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99000bc0-5b18-595a-aa09-80e0730a8140 with identifier: AA81624 to the API
2026-03-28 05:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:15:15Z',
 'fuel_type': 'diesel',
 'id': '99000bc0-5b18-595a-aa09-80e0730a8140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA81624',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 107887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI extralang',
 'transmission': 'manual',
 'trim': 'extralang',
 'year': 2020}
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA81624%27 HTTP/1.1" 200 None
2026-03-28 05:30:22 [auto1.de] INFO: Saving data for AA81624: {'auction_closing_time': 1774714515.0, 'created_time': 1774550551.85758, 'last_price_update_time': 1774675822.085339}
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA81624') HTTP/1.1" 204 0
2026-03-28 05:30:22 [auto1.de] INFO: Found listing with ID: NW69156
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW69156%27 HTTP/1.1" 200 None
2026-03-28 05:30:22 [auto1.de] INFO: Scrape type for NW69156: 2
2026-03-28 05:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fde3c40-dd7a-5e35-ab44-2499d09b7b83 with identifier: NW69156
2026-03-28 05:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fde3c40-dd7a-5e35-ab44-2499d09b7b83 with scrape type 2
2026-03-28 05:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fde3c40-dd7a-5e35-ab44-2499d09b7b83 with scrape type 2
2026-03-28 05:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fde3c40-dd7a-5e35-ab44-2499d09b7b83, identifier: NW69156
2026-03-28 05:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fde3c40-dd7a-5e35-ab44-2499d09b7b83 with identifier: NW69156
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 05:30:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fde3c40-dd7a-5e35-ab44-2499d09b7b83 with identifier: NW69156
2026-03-28 05:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fde3c40-dd7a-5e35-ab44-2499d09b7b83 with identifier: NW69156 to the API
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:49:53Z',
 'fuel_type': 'diesel',
 'id': '8fde3c40-dd7a-5e35-ab44-2499d09b7b83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW69156',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 72885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-05',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 111 CDI lang Tourer Edition',
 'transmission': 'manual',
 'trim': 'lang Tourer Edition',
 'year': 2018}
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW69156%27 HTTP/1.1" 200 None
2026-03-28 05:30:22 [auto1.de] INFO: Saving data for NW69156: {'auction_closing_time': 1774716593.0, 'created_time': 1774552528.016476, 'last_price_update_time': 1774675822.647976}
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW69156') HTTP/1.1" 204 0
2026-03-28 05:30:22 [auto1.de] INFO: Found listing with ID: NP38259
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP38259%27 HTTP/1.1" 200 None
2026-03-28 05:30:22 [auto1.de] INFO: Scrape type for NP38259: 1
2026-03-28 05:30:22 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-28 05:30:22 [auto1.de] INFO: Scrape type for UL41666: 1
2026-03-28 05:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:22 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-28 05:30:22 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-28 05:30:22 [auto1.de] INFO: Scrape type for WL17910: 1
2026-03-28 05:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:22 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-28 05:30:22 [auto1.de] INFO: Found listing with ID: SG07809
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG07809%27 HTTP/1.1" 200 None
2026-03-28 05:30:22 [auto1.de] INFO: Scrape type for SG07809: 2
2026-03-28 05:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d7b01cc-a4ae-54e9-8cf4-0b2153c20690 with identifier: SG07809
2026-03-28 05:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7b01cc-a4ae-54e9-8cf4-0b2153c20690 with scrape type 2
2026-03-28 05:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d7b01cc-a4ae-54e9-8cf4-0b2153c20690 with scrape type 2
2026-03-28 05:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d7b01cc-a4ae-54e9-8cf4-0b2153c20690, identifier: SG07809
2026-03-28 05:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d7b01cc-a4ae-54e9-8cf4-0b2153c20690 with identifier: SG07809
2026-03-28 05:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d7b01cc-a4ae-54e9-8cf4-0b2153c20690 with identifier: SG07809
2026-03-28 05:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d7b01cc-a4ae-54e9-8cf4-0b2153c20690 with identifier: SG07809 to the API
2026-03-28 05:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:11Z',
 'fuel_type': 'diesel',
 'id': '0d7b01cc-a4ae-54e9-8cf4-0b2153c20690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG07809',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 172990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-20',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG07809%27 HTTP/1.1" 200 None
2026-03-28 05:30:24 [auto1.de] INFO: Saving data for SG07809: {'auction_closing_time': 1774714511.0, 'created_time': 1774349575.984982, 'last_price_update_time': 1774675824.325691}
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG07809') HTTP/1.1" 204 0
2026-03-28 05:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:24 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-28 05:30:24 [auto1.de] INFO: Scrape type for ZJ20078: 1
2026-03-28 05:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:24 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-28 05:30:24 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-28 05:30:24 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-28 05:30:24 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-28 05:30:24 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-28 05:30:24 [auto1.de] INFO: Scrape type for MM43491: 1
2026-03-28 05:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:24 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-28 05:30:24 [auto1.de] INFO: Found listing with ID: YD03846
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD03846%27 HTTP/1.1" 200 None
2026-03-28 05:30:24 [auto1.de] INFO: Scrape type for YD03846: 2
2026-03-28 05:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32ba042c-ccc4-5962-9dd8-269843cb9aa7 with identifier: YD03846
2026-03-28 05:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32ba042c-ccc4-5962-9dd8-269843cb9aa7 with scrape type 2
2026-03-28 05:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32ba042c-ccc4-5962-9dd8-269843cb9aa7 with scrape type 2
2026-03-28 05:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32ba042c-ccc4-5962-9dd8-269843cb9aa7, identifier: YD03846
2026-03-28 05:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32ba042c-ccc4-5962-9dd8-269843cb9aa7 with identifier: YD03846
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 05:30:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 05:30:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32ba042c-ccc4-5962-9dd8-269843cb9aa7 with identifier: YD03846
2026-03-28 05:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32ba042c-ccc4-5962-9dd8-269843cb9aa7 with identifier: YD03846 to the API
2026-03-28 05:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:38:36Z',
 'fuel_type': 'petrol',
 'id': '32ba042c-ccc4-5962-9dd8-269843cb9aa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD03846',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 109901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-10',
 'seller_name': None,
 'title': 'Seat Leon 1.0 TSI Reference Ecomotive',
 'transmission': 'manual',
 'trim': 'Reference Ecomotive',
 'year': 2016}
2026-03-28 05:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD03846%27 HTTP/1.1" 200 None
2026-03-28 05:30:25 [auto1.de] INFO: Saving data for YD03846: {'auction_closing_time': 1774715916.0, 'created_time': 1773660406.988503, 'last_price_update_time': 1774675825.413251}
2026-03-28 05:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD03846') HTTP/1.1" 204 0
2026-03-28 05:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:25 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-28 05:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-28 05:30:25 [auto1.de] INFO: Scrape type for NF38330: 1
2026-03-28 05:30:25 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 9199 | hits on page: 40
2026-03-28 05:30:25 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-28 05:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-28 05:30:25 [auto1.de] INFO: Scrape type for TF89419: 2
2026-03-28 05:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf8c203-9a5f-5e02-afb5-18025b5e525c with identifier: TF89419
2026-03-28 05:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbf8c203-9a5f-5e02-afb5-18025b5e525c with scrape type 2
2026-03-28 05:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbf8c203-9a5f-5e02-afb5-18025b5e525c with scrape type 2
2026-03-28 05:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbf8c203-9a5f-5e02-afb5-18025b5e525c, identifier: TF89419
2026-03-28 05:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbf8c203-9a5f-5e02-afb5-18025b5e525c with identifier: TF89419
2026-03-28 05:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbf8c203-9a5f-5e02-afb5-18025b5e525c with identifier: TF89419
2026-03-28 05:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbf8c203-9a5f-5e02-afb5-18025b5e525c with identifier: TF89419 to the API
2026-03-28 05:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-28T16:56:26Z',
 'fuel_type': 'petrol',
 'id': 'cbf8c203-9a5f-5e02-afb5-18025b5e525c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF89419',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 40221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-23',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2022}
2026-03-28 05:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-28 05:30:27 [auto1.de] INFO: Saving data for TF89419: {'auction_closing_time': 1774716986.0, 'created_time': 1773946255.713134, 'last_price_update_time': 1774675827.006798}
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF89419') HTTP/1.1" 204 0
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: SR82375
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR82375%27 HTTP/1.1" 200 None
2026-03-28 05:30:27 [auto1.de] INFO: Scrape type for SR82375: 0
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: FH90697
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH90697%27 HTTP/1.1" 200 None
2026-03-28 05:30:27 [auto1.de] INFO: Scrape type for FH90697: 0
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: YV38391
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV38391%27 HTTP/1.1" 200 None
2026-03-28 05:30:27 [auto1.de] INFO: Scrape type for YV38391: 0
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: WB33854
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: XE46726
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE46726%27 HTTP/1.1" 200 None
2026-03-28 05:30:27 [auto1.de] INFO: Scrape type for XE46726: 0
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: KG17192
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-28 05:30:27 [auto1.de] INFO: Scrape type for MT99965: 0
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA81624%27 HTTP/1.1" 200 None
2026-03-28 05:30:27 [auto1.de] INFO: Scrape type for AA81624: 0
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: NW69156
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW69156%27 HTTP/1.1" 200 None
2026-03-28 05:30:27 [auto1.de] INFO: Scrape type for NW69156: 0
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: NP38259
2026-03-28 05:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-28 05:30:27 [auto1.de] INFO: Scrape type for UE91712: 2
2026-03-28 05:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3c314c7-23c9-5995-be4b-e85c3de39485 with identifier: UE91712
2026-03-28 05:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c314c7-23c9-5995-be4b-e85c3de39485 with scrape type 2
2026-03-28 05:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3c314c7-23c9-5995-be4b-e85c3de39485 with scrape type 2
2026-03-28 05:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3c314c7-23c9-5995-be4b-e85c3de39485, identifier: UE91712
2026-03-28 05:30:27 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/NP38259/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 05:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3c314c7-23c9-5995-be4b-e85c3de39485 with identifier: UE91712
2026-03-28 05:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3c314c7-23c9-5995-be4b-e85c3de39485 with identifier: UE91712
2026-03-28 05:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3c314c7-23c9-5995-be4b-e85c3de39485 with identifier: UE91712 to the API
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:38:46Z',
 'fuel_type': 'petrol',
 'id': 'a3c314c7-23c9-5995-be4b-e85c3de39485',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE91712',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 246357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Lounge Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-28 05:30:27 [auto1.de] INFO: Saving data for UE91712: {'auction_closing_time': 1774715926.0, 'created_time': 1773345407.049446, 'last_price_update_time': 1774675827.784598}
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE91712') HTTP/1.1" 204 0
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-28 05:30:27 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-28 05:30:27 [auto1.de] INFO: Scrape type for AB05570: 2
2026-03-28 05:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b86b7b-686c-5c67-87e1-5d172adaac8b with identifier: AB05570
2026-03-28 05:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b86b7b-686c-5c67-87e1-5d172adaac8b with scrape type 2
2026-03-28 05:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b86b7b-686c-5c67-87e1-5d172adaac8b with scrape type 2
2026-03-28 05:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65b86b7b-686c-5c67-87e1-5d172adaac8b, identifier: AB05570
2026-03-28 05:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65b86b7b-686c-5c67-87e1-5d172adaac8b with identifier: AB05570
2026-03-28 05:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65b86b7b-686c-5c67-87e1-5d172adaac8b with identifier: AB05570
2026-03-28 05:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65b86b7b-686c-5c67-87e1-5d172adaac8b with identifier: AB05570 to the API
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:03:06Z',
 'fuel_type': 'petrol',
 'id': '65b86b7b-686c-5c67-87e1-5d172adaac8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB05570',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 138218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-07',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 350 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2011}
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-28 05:30:28 [auto1.de] INFO: Saving data for AB05570: {'auction_closing_time': 1774713786.0, 'created_time': 1774034463.486644, 'last_price_update_time': 1774675828.490861}
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB05570') HTTP/1.1" 204 0
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-28 05:30:28 [auto1.de] INFO: Scrape type for BS96565: 1
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: SG07809
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG07809%27 HTTP/1.1" 200 None
2026-03-28 05:30:28 [auto1.de] INFO: Scrape type for SG07809: 0
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-28 05:30:28 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-28 05:30:28 [auto1.de] INFO: Scrape type for BP25717: 2
2026-03-28 05:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beb24744-09b9-5565-8a9d-5dc6a0f4f887 with identifier: BP25717
2026-03-28 05:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beb24744-09b9-5565-8a9d-5dc6a0f4f887 with scrape type 2
2026-03-28 05:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beb24744-09b9-5565-8a9d-5dc6a0f4f887 with scrape type 2
2026-03-28 05:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: beb24744-09b9-5565-8a9d-5dc6a0f4f887, identifier: BP25717
2026-03-28 05:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL41666/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: beb24744-09b9-5565-8a9d-5dc6a0f4f887 with identifier: BP25717
2026-03-28 05:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: beb24744-09b9-5565-8a9d-5dc6a0f4f887 with identifier: BP25717
2026-03-28 05:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: beb24744-09b9-5565-8a9d-5dc6a0f4f887 with identifier: BP25717 to the API
2026-03-28 05:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:29:37Z',
 'fuel_type': 'petrol',
 'id': 'beb24744-09b9-5565-8a9d-5dc6a0f4f887',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP25717',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 11068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-28',
 'seller_name': None,
 'title': 'Opel Karl 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-28 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-28 05:30:29 [auto1.de] INFO: Saving data for BP25717: {'auction_closing_time': 1774715377.0, 'created_time': 1773307624.107882, 'last_price_update_time': 1774675829.656418}
2026-03-28 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP25717') HTTP/1.1" 204 0
2026-03-28 05:30:29 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-28 05:30:29 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-28 05:30:29 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-28 05:30:29 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-28 05:30:29 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-28 05:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:29 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-28 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-28 05:30:29 [auto1.de] INFO: Scrape type for AG68555: 2
2026-03-28 05:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba71c422-5647-58af-b31c-b8ed3c8681c6 with identifier: AG68555
2026-03-28 05:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba71c422-5647-58af-b31c-b8ed3c8681c6 with scrape type 2
2026-03-28 05:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba71c422-5647-58af-b31c-b8ed3c8681c6 with scrape type 2
2026-03-28 05:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba71c422-5647-58af-b31c-b8ed3c8681c6, identifier: AG68555
2026-03-28 05:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba71c422-5647-58af-b31c-b8ed3c8681c6 with identifier: AG68555
2026-03-28 05:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 05:30:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba71c422-5647-58af-b31c-b8ed3c8681c6 with identifier: AG68555
2026-03-28 05:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba71c422-5647-58af-b31c-b8ed3c8681c6 with identifier: AG68555 to the API
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:05:11Z',
 'fuel_type': 'hybrid',
 'id': 'ba71c422-5647-58af-b31c-b8ed3c8681c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG68555',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 23282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2021}
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-28 05:30:30 [auto1.de] INFO: Saving data for AG68555: {'auction_closing_time': 1774713911.0, 'created_time': 1774349830.615802, 'last_price_update_time': 1774675830.536049}
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG68555') HTTP/1.1" 204 0
2026-03-28 05:30:30 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-28 05:30:30 [auto1.de] INFO: Found listing with ID: YD03846
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD03846%27 HTTP/1.1" 200 None
2026-03-28 05:30:30 [auto1.de] INFO: Scrape type for YD03846: 0
2026-03-28 05:30:30 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-28 05:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM43491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL17910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:30 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-28 05:30:30 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-28 05:30:30 [auto1.de] INFO: Scrape type for SD88360: 2
2026-03-28 05:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c08b9843-95be-5d3c-bb0c-fbc008695d2c with identifier: SD88360
2026-03-28 05:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c08b9843-95be-5d3c-bb0c-fbc008695d2c with scrape type 2
2026-03-28 05:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c08b9843-95be-5d3c-bb0c-fbc008695d2c with scrape type 2
2026-03-28 05:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c08b9843-95be-5d3c-bb0c-fbc008695d2c, identifier: SD88360
2026-03-28 05:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ20078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP38259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c08b9843-95be-5d3c-bb0c-fbc008695d2c with identifier: SD88360
2026-03-28 05:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c08b9843-95be-5d3c-bb0c-fbc008695d2c with identifier: SD88360
2026-03-28 05:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c08b9843-95be-5d3c-bb0c-fbc008695d2c with identifier: SD88360 to the API
2026-03-28 05:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:00:37Z',
 'fuel_type': 'petrol',
 'id': 'c08b9843-95be-5d3c-bb0c-fbc008695d2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD88360',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 121816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Citroen C3 1.2 e-VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-28 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-28 05:30:31 [auto1.de] INFO: Saving data for SD88360: {'auction_closing_time': 1774713637.0, 'created_time': 1773303151.567717, 'last_price_update_time': 1774675831.96775}
2026-03-28 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD88360') HTTP/1.1" 204 0
2026-03-28 05:30:31 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-28 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-28 05:30:32 [auto1.de] INFO: Scrape type for TF89419: 0
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-28 05:30:32 [auto1.de] INFO: Scrape type for UE91712: 0
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-28 05:30:32 [auto1.de] INFO: Scrape type for AB05570: 0
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-28 05:30:32 [auto1.de] INFO: Scrape type for JT47484: 1
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-28 05:30:32 [auto1.de] INFO: Scrape type for BP25717: 0
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-28 05:30:32 [auto1.de] INFO: Scrape type for AG68555: 0
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-28 05:30:32 [auto1.de] INFO: Scrape type for SD88360: 0
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-28 05:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF38330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:32 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 9199 | hits on page: 40
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: PC15308
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: MS28207
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-28 05:30:32 [auto1.de] INFO: Scrape type for RA04600: 1
2026-03-28 05:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: XL55918
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL55918%27 HTTP/1.1" 200 None
2026-03-28 05:30:32 [auto1.de] INFO: Scrape type for XL55918: 2
2026-03-28 05:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3b71467-35d3-5b52-b377-95729847fb76 with identifier: XL55918
2026-03-28 05:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3b71467-35d3-5b52-b377-95729847fb76 with scrape type 2
2026-03-28 05:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3b71467-35d3-5b52-b377-95729847fb76 with scrape type 2
2026-03-28 05:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3b71467-35d3-5b52-b377-95729847fb76, identifier: XL55918
2026-03-28 05:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3b71467-35d3-5b52-b377-95729847fb76 with identifier: XL55918
2026-03-28 05:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3b71467-35d3-5b52-b377-95729847fb76 with identifier: XL55918
2026-03-28 05:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3b71467-35d3-5b52-b377-95729847fb76 with identifier: XL55918 to the API
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:35Z',
 'fuel_type': 'diesel',
 'id': 'd3b71467-35d3-5b52-b377-95729847fb76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL55918',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 142099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-10',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L1 Family Comfort',
 'transmission': 'manual',
 'trim': 'L1 Family Comfort',
 'year': 2019}
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL55918%27 HTTP/1.1" 200 None
2026-03-28 05:30:32 [auto1.de] INFO: Saving data for XL55918: {'auction_closing_time': 1774715495.0, 'created_time': 1773830470.371977, 'last_price_update_time': 1774675832.693981}
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL55918') HTTP/1.1" 204 0
2026-03-28 05:30:32 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-28 05:30:32 [auto1.de] INFO: Scrape type for HL58412: 2
2026-03-28 05:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01d7679a-6128-5203-ba72-ad94d328f46b with identifier: HL58412
2026-03-28 05:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01d7679a-6128-5203-ba72-ad94d328f46b with scrape type 2
2026-03-28 05:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01d7679a-6128-5203-ba72-ad94d328f46b with scrape type 2
2026-03-28 05:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01d7679a-6128-5203-ba72-ad94d328f46b, identifier: HL58412
2026-03-28 05:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01d7679a-6128-5203-ba72-ad94d328f46b with identifier: HL58412
2026-03-28 05:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01d7679a-6128-5203-ba72-ad94d328f46b with identifier: HL58412
2026-03-28 05:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01d7679a-6128-5203-ba72-ad94d328f46b with identifier: HL58412 to the API
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:22:31Z',
 'fuel_type': 'petrol',
 'id': '01d7679a-6128-5203-ba72-ad94d328f46b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL58412',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 26297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2020}
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-28 05:30:33 [auto1.de] INFO: Saving data for HL58412: {'auction_closing_time': 1774714951.0, 'created_time': 1773427811.198421, 'last_price_update_time': 1774675833.261569}
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL58412') HTTP/1.1" 204 0
2026-03-28 05:30:33 [auto1.de] INFO: Found listing with ID: NV14001
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV14001%27 HTTP/1.1" 200 None
2026-03-28 05:30:33 [auto1.de] INFO: Scrape type for NV14001: 2
2026-03-28 05:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d752177-c106-57ac-96ba-466ac8b5c631 with identifier: NV14001
2026-03-28 05:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d752177-c106-57ac-96ba-466ac8b5c631 with scrape type 2
2026-03-28 05:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d752177-c106-57ac-96ba-466ac8b5c631 with scrape type 2
2026-03-28 05:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d752177-c106-57ac-96ba-466ac8b5c631, identifier: NV14001
2026-03-28 05:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d752177-c106-57ac-96ba-466ac8b5c631 with identifier: NV14001
2026-03-28 05:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d752177-c106-57ac-96ba-466ac8b5c631 with identifier: NV14001
2026-03-28 05:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d752177-c106-57ac-96ba-466ac8b5c631 with identifier: NV14001 to the API
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:32Z',
 'fuel_type': 'diesel',
 'id': '9d752177-c106-57ac-96ba-466ac8b5c631',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV14001',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 189231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-16',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2014}
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV14001%27 HTTP/1.1" 200 None
2026-03-28 05:30:33 [auto1.de] INFO: Saving data for NV14001: {'auction_closing_time': 1774716992.0, 'created_time': 1774033625.168687, 'last_price_update_time': 1774675833.698101}
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV14001') HTTP/1.1" 204 0
2026-03-28 05:30:33 [auto1.de] INFO: Found listing with ID: DB45591
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB45591%27 HTTP/1.1" 200 None
2026-03-28 05:30:33 [auto1.de] INFO: Scrape type for DB45591: 0
2026-03-28 05:30:33 [auto1.de] INFO: Found listing with ID: LG34778
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG34778%27 HTTP/1.1" 200 None
2026-03-28 05:30:33 [auto1.de] INFO: Scrape type for LG34778: 0
2026-03-28 05:30:33 [auto1.de] INFO: Found listing with ID: GP45191
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45191%27 HTTP/1.1" 200 None
2026-03-28 05:30:33 [auto1.de] INFO: Scrape type for GP45191: 1
2026-03-28 05:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS96565/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:33 [auto1.de] INFO: Found listing with ID: CB43306
2026-03-28 05:30:33 [auto1.de] INFO: Found listing with ID: AA51381
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51381%27 HTTP/1.1" 200 None
2026-03-28 05:30:33 [auto1.de] INFO: Scrape type for AA51381: 0
2026-03-28 05:30:33 [auto1.de] INFO: Found listing with ID: JL74315
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL74315%27 HTTP/1.1" 200 None
2026-03-28 05:30:33 [auto1.de] INFO: Scrape type for JL74315: 0
2026-03-28 05:30:33 [auto1.de] INFO: Found listing with ID: UF03548
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF03548%27 HTTP/1.1" 200 None
2026-03-28 05:30:33 [auto1.de] INFO: Scrape type for UF03548: 2
2026-03-28 05:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7add79c7-db32-5508-b65b-dc91d981f056 with identifier: UF03548
2026-03-28 05:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7add79c7-db32-5508-b65b-dc91d981f056 with scrape type 2
2026-03-28 05:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7add79c7-db32-5508-b65b-dc91d981f056 with scrape type 2
2026-03-28 05:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7add79c7-db32-5508-b65b-dc91d981f056, identifier: UF03548
2026-03-28 05:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7add79c7-db32-5508-b65b-dc91d981f056 with identifier: UF03548
2026-03-28 05:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7add79c7-db32-5508-b65b-dc91d981f056 with identifier: UF03548
2026-03-28 05:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7add79c7-db32-5508-b65b-dc91d981f056 with identifier: UF03548 to the API
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:52:27Z',
 'fuel_type': 'petrol',
 'id': '7add79c7-db32-5508-b65b-dc91d981f056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF03548',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 69860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-09',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B4 Mild-Hybrid R Design 2WD',
 'transmission': 'automatic',
 'trim': 'R Design 2WD',
 'year': 2022}
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF03548%27 HTTP/1.1" 200 None
2026-03-28 05:30:34 [auto1.de] INFO: Saving data for UF03548: {'auction_closing_time': 1774716747.0, 'created_time': 1772728161.431095, 'last_price_update_time': 1774675834.257657}
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF03548') HTTP/1.1" 204 0
2026-03-28 05:30:34 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-28 05:30:34 [auto1.de] INFO: Scrape type for BB27376: 2
2026-03-28 05:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376
2026-03-28 05:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with scrape type 2
2026-03-28 05:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with scrape type 2
2026-03-28 05:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc, identifier: BB27376
2026-03-28 05:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376
2026-03-28 05:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376
2026-03-28 05:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376 to the API
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:25Z',
 'fuel_type': 'diesel',
 'id': '13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB27376',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 204104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-28',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-28 05:30:34 [auto1.de] INFO: Saving data for BB27376: {'auction_closing_time': 1774715725.0, 'created_time': 1774034616.410443, 'last_price_update_time': 1774675834.784558}
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB27376') HTTP/1.1" 204 0
2026-03-28 05:30:34 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-28 05:30:34 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-28 05:30:34 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-28 05:30:34 [auto1.de] INFO: Scrape type for AL26903: 1
2026-03-28 05:30:34 [auto1.de] INFO: Found listing with ID: XL09941
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL09941%27 HTTP/1.1" 200 None
2026-03-28 05:30:34 [auto1.de] INFO: Scrape type for XL09941: 1
2026-03-28 05:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL41666> (referer: https://www.auto1.com/v1/car-details-view/UL41666/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT47484/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ20078> (referer: https://www.auto1.com/v1/car-details-view/ZJ20078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP38259> (referer: https://www.auto1.com/v1/car-details-view/NP38259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:34 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-28 05:30:34 [auto1.de] INFO: Scrape type for ZM37202: 2
2026-03-28 05:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faa7c777-628e-5189-aa6a-3659d2046358 with identifier: ZM37202
2026-03-28 05:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faa7c777-628e-5189-aa6a-3659d2046358 with scrape type 2
2026-03-28 05:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faa7c777-628e-5189-aa6a-3659d2046358 with scrape type 2
2026-03-28 05:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faa7c777-628e-5189-aa6a-3659d2046358, identifier: ZM37202
2026-03-28 05:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faa7c777-628e-5189-aa6a-3659d2046358 with identifier: ZM37202
2026-03-28 05:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faa7c777-628e-5189-aa6a-3659d2046358 with identifier: ZM37202
2026-03-28 05:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faa7c777-628e-5189-aa6a-3659d2046358 with identifier: ZM37202 to the API
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:19:40Z',
 'fuel_type': 'diesel',
 'id': 'faa7c777-628e-5189-aa6a-3659d2046358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM37202',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 136723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-19',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-28 05:30:35 [auto1.de] INFO: Saving data for ZM37202: {'auction_closing_time': 1774714780.0, 'created_time': 1773226428.621854, 'last_price_update_time': 1774675835.302146}
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM37202') HTTP/1.1" 204 0
2026-03-28 05:30:35 [auto1.de] INFO: Found listing with ID: GR29564
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR29564%27 HTTP/1.1" 200 None
2026-03-28 05:30:35 [auto1.de] INFO: Scrape type for GR29564: 1
2026-03-28 05:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM43491> (referer: https://www.auto1.com/v1/car-details-view/MM43491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL17910> (referer: https://www.auto1.com/v1/car-details-view/WL17910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:35 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-28 05:30:35 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-28 05:30:35 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-28 05:30:35 [auto1.de] INFO: Found listing with ID: PG01901
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG01901%27 HTTP/1.1" 200 None
2026-03-28 05:30:35 [auto1.de] INFO: Scrape type for PG01901: 2
2026-03-28 05:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f7e47b-d1e9-527c-966d-1224d4bc41ec with identifier: PG01901
2026-03-28 05:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f7e47b-d1e9-527c-966d-1224d4bc41ec with scrape type 2
2026-03-28 05:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87f7e47b-d1e9-527c-966d-1224d4bc41ec with scrape type 2
2026-03-28 05:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87f7e47b-d1e9-527c-966d-1224d4bc41ec, identifier: PG01901
2026-03-28 05:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87f7e47b-d1e9-527c-966d-1224d4bc41ec with identifier: PG01901
2026-03-28 05:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87f7e47b-d1e9-527c-966d-1224d4bc41ec with identifier: PG01901
2026-03-28 05:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87f7e47b-d1e9-527c-966d-1224d4bc41ec with identifier: PG01901 to the API
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:49Z',
 'fuel_type': 'diesel',
 'id': '87f7e47b-d1e9-527c-966d-1224d4bc41ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG01901',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 246652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-16',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG01901%27 HTTP/1.1" 200 None
2026-03-28 05:30:35 [auto1.de] INFO: Saving data for PG01901: {'auction_closing_time': 1774716469.0, 'created_time': 1773135166.606556, 'last_price_update_time': 1774675835.874643}
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG01901') HTTP/1.1" 204 0
2026-03-28 05:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98bc471b-5c92-5567-9edc-a7703c627883 with identifier: UL41666
2026-03-28 05:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98bc471b-5c92-5567-9edc-a7703c627883 with scrape type 1
2026-03-28 05:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98bc471b-5c92-5567-9edc-a7703c627883
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F27%252Fcd274534f4e0e346088ee3642c7865d3%252Fpa%252FUL41666_6b8ded8fb528a2cfc35575338c6ebdf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_6b8ded8fb528a2cfc35575338c6ebdf6.jpg already downloaded
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F27%252Fcd274534f4e0e346088ee3642c7865d3%252Fpa%252FUL41666_626bf8d0b0369f52c1c125eefdb61e50.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_626bf8d0b0369f52c1c125eefdb61e50.jpg already downloaded
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F27%252Fcd274534f4e0e346088ee3642c7865d3%252Fpa%252FUL41666_6ee8f48930d0dff2102386f57196e8be.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_6ee8f48930d0dff2102386f57196e8be.jpg already downloaded
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F27%252Fcd274534f4e0e346088ee3642c7865d3%252Fpa%252FUL41666_c3df68b3a6c1b5f6fb7948b214437df6.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_c3df68b3a6c1b5f6fb7948b214437df6.jpg already downloaded
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F27%252Fcd274534f4e0e346088ee3642c7865d3%252Fpa%252FUL41666_430af5dfb7ec2cd21fbe2806781af807.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_430af5dfb7ec2cd21fbe2806781af807.jpg already downloaded
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F27%252Fcd274534f4e0e346088ee3642c7865d3%252Fpa%252FUL41666_ccc1bb3c3254ff625d466bd0ceed8006.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_ccc1bb3c3254ff625d466bd0ceed8006.jpg already downloaded
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F27%252Fcd274534f4e0e346088ee3642c7865d3%252Fpa%252FUL41666_e335e9b574e8428c6e60512059374dd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_e335e9b574e8428c6e60512059374dd5.jpg already downloaded
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F27%252Fcd274534f4e0e346088ee3642c7865d3%252Fpa%252FUL41666_80c9ba41e38766b467c70b4d126688bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_80c9ba41e38766b467c70b4d126688bc.jpg already downloaded
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F27%252Fcd274534f4e0e346088ee3642c7865d3%252Fpa%252FUL41666_27c6c9bb93fc3ef0ff1735db0de20e09.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_27c6c9bb93fc3ef0ff1735db0de20e09.jpg already downloaded
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F27%252Fcd274534f4e0e346088ee3642c7865d3%252Fpa%252FUL41666_c92ceaa8df3faa465a0e83fc8d4159e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_c92ceaa8df3faa465a0e83fc8d4159e5.jpg already downloaded
2026-03-28 05:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98bc471b-5c92-5567-9edc-a7703c627883, identifier: UL41666
2026-03-28 05:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9301628-71bd-55e5-9dce-82d4ff083f06 with identifier: ZJ20078
2026-03-28 05:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9301628-71bd-55e5-9dce-82d4ff083f06 with scrape type 1
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9301628-71bd-55e5-9dce-82d4ff083f06
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_b985307472630905b2d5bfb8148313ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_b985307472630905b2d5bfb8148313ef.jpg not downloaded yet
2026-03-28 05:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14fbc4be-d54e-5514-a2aa-511aa7bb79c8 with identifier: NP38259
2026-03-28 05:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14fbc4be-d54e-5514-a2aa-511aa7bb79c8 with scrape type 1
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 14fbc4be-d54e-5514-a2aa-511aa7bb79c8
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_64e28a833398758f5ebb38d8223fbe7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_64e28a833398758f5ebb38d8223fbe7b.jpg not downloaded yet
2026-03-28 05:30:36 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-28 05:30:36 [auto1.de] INFO: Found listing with ID: XB18292
2026-03-28 05:30:36 [auto1.de] INFO: Found listing with ID: XB21556
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB21556%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [auto1.de] INFO: Scrape type for XB21556: 1
2026-03-28 05:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98bc471b-5c92-5567-9edc-a7703c627883 with identifier: UL41666
2026-03-28 05:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98bc471b-5c92-5567-9edc-a7703c627883 with identifier: UL41666
2026-03-28 05:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98bc471b-5c92-5567-9edc-a7703c627883 with identifier: UL41666 to the API
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL41666>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:47:26Z',
 'fuel_type': 'petrol',
 'id': '98bc471b-5c92-5567-9edc-a7703c627883',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL41666',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 112458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_6b8ded8fb528a2cfc35575338c6ebdf6.jpg',
                'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_626bf8d0b0369f52c1c125eefdb61e50.jpg',
                'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_6ee8f48930d0dff2102386f57196e8be.jpg',
                'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_c3df68b3a6c1b5f6fb7948b214437df6.jpg',
                'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_430af5dfb7ec2cd21fbe2806781af807.jpg',
                'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_ccc1bb3c3254ff625d466bd0ceed8006.jpg',
                'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_e335e9b574e8428c6e60512059374dd5.jpg',
                'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_80c9ba41e38766b467c70b4d126688bc.jpg',
                'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_27c6c9bb93fc3ef0ff1735db0de20e09.jpg',
                'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_c92ceaa8df3faa465a0e83fc8d4159e5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc471b-5c92-5567-9edc-a7703c627883/98bc471b-5c92-5567-9edc-a7703c627883_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_6b8ded8fb528a2cfc35575338c6ebdf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc471b-5c92-5567-9edc-a7703c627883/98bc471b-5c92-5567-9edc-a7703c627883_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_626bf8d0b0369f52c1c125eefdb61e50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc471b-5c92-5567-9edc-a7703c627883/98bc471b-5c92-5567-9edc-a7703c627883_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_6ee8f48930d0dff2102386f57196e8be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc471b-5c92-5567-9edc-a7703c627883/98bc471b-5c92-5567-9edc-a7703c627883_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_c3df68b3a6c1b5f6fb7948b214437df6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc471b-5c92-5567-9edc-a7703c627883/98bc471b-5c92-5567-9edc-a7703c627883_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_430af5dfb7ec2cd21fbe2806781af807.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc471b-5c92-5567-9edc-a7703c627883/98bc471b-5c92-5567-9edc-a7703c627883_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_ccc1bb3c3254ff625d466bd0ceed8006.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc471b-5c92-5567-9edc-a7703c627883/98bc471b-5c92-5567-9edc-a7703c627883_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_e335e9b574e8428c6e60512059374dd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc471b-5c92-5567-9edc-a7703c627883/98bc471b-5c92-5567-9edc-a7703c627883_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_80c9ba41e38766b467c70b4d126688bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc471b-5c92-5567-9edc-a7703c627883/98bc471b-5c92-5567-9edc-a7703c627883_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_27c6c9bb93fc3ef0ff1735db0de20e09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98bc471b-5c92-5567-9edc-a7703c627883/98bc471b-5c92-5567-9edc-a7703c627883_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/27/cd274534f4e0e346088ee3642c7865d3/pa/UL41666_c92ceaa8df3faa465a0e83fc8d4159e5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [auto1.de] INFO: Saving data for UL41666: {'created_time': 1774675836.55743, 'last_price_update_time': 1774675836.557442, 'auction_closing_time': 1774716446.0}
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL41666') HTTP/1.1" 204 0
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_ab7dd61ce7c040fa8bdf7e4829d91d66.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_ab7dd61ce7c040fa8bdf7e4829d91d66.jpg not downloaded yet
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_2ebfd088995b450983494f1adb4710e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_2ebfd088995b450983494f1adb4710e4.jpg not downloaded yet
2026-03-28 05:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f935c431-cf02-51e5-9b07-76168393dbfd with identifier: MM43491
2026-03-28 05:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f935c431-cf02-51e5-9b07-76168393dbfd with scrape type 1
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f935c431-cf02-51e5-9b07-76168393dbfd
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_9fa69bf182ea5bcc3f9fc97999737b83.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_9fa69bf182ea5bcc3f9fc97999737b83.jpg not downloaded yet
2026-03-28 05:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fb498fa-e45b-58f3-9031-e12b9313f8d8 with identifier: WL17910
2026-03-28 05:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fb498fa-e45b-58f3-9031-e12b9313f8d8 with scrape type 1
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8fb498fa-e45b-58f3-9031-e12b9313f8d8
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F22%252Feb22c513ed7745f63efae7035ae009a2%252Fpa%252FWL17910_65be089a84f87c082d4cd6aae39610ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_65be089a84f87c082d4cd6aae39610ed.jpg already downloaded
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F22%252Feb22c513ed7745f63efae7035ae009a2%252Fpa%252FWL17910_2826961ce00e84b0b19f3c8612e96d10.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_2826961ce00e84b0b19f3c8612e96d10.jpg already downloaded
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F22%252Feb22c513ed7745f63efae7035ae009a2%252Fpa%252FWL17910_5c0f24fb05aac4b2ad5c379c79f8b86f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_5c0f24fb05aac4b2ad5c379c79f8b86f.jpg already downloaded
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F22%252Feb22c513ed7745f63efae7035ae009a2%252Fpa%252FWL17910_d580a621ab967b18a8dbf0a1b0b8096b.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_d580a621ab967b18a8dbf0a1b0b8096b.jpg already downloaded
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F22%252Feb22c513ed7745f63efae7035ae009a2%252Fpa%252FWL17910_ce6dd392727fe327d90660d4df42b875.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_ce6dd392727fe327d90660d4df42b875.jpg already downloaded
2026-03-28 05:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fb498fa-e45b-58f3-9031-e12b9313f8d8, identifier: WL17910
2026-03-28 05:30:36 [auto1.de] INFO: Found listing with ID: VH56486
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH56486%27 HTTP/1.1" 200 None
2026-03-28 05:30:36 [auto1.de] INFO: Scrape type for VH56486: 2
2026-03-28 05:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c7649a9-d267-516c-9baf-74c739405808 with identifier: VH56486
2026-03-28 05:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c7649a9-d267-516c-9baf-74c739405808 with scrape type 2
2026-03-28 05:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c7649a9-d267-516c-9baf-74c739405808 with scrape type 2
2026-03-28 05:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c7649a9-d267-516c-9baf-74c739405808, identifier: VH56486
2026-03-28 05:30:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fb498fa-e45b-58f3-9031-e12b9313f8d8 with identifier: WL17910
2026-03-28 05:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fb498fa-e45b-58f3-9031-e12b9313f8d8 with identifier: WL17910
2026-03-28 05:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fb498fa-e45b-58f3-9031-e12b9313f8d8 with identifier: WL17910 to the API
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WL17910>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:21:12Z',
 'fuel_type': 'diesel',
 'id': '8fb498fa-e45b-58f3-9031-e12b9313f8d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL17910',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'BMW',
 'model': '1er',
 'odometer': 248008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_65be089a84f87c082d4cd6aae39610ed.jpg',
                'https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_2826961ce00e84b0b19f3c8612e96d10.jpg',
                'https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_5c0f24fb05aac4b2ad5c379c79f8b86f.jpg',
                'https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_d580a621ab967b18a8dbf0a1b0b8096b.jpg',
                'https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_ce6dd392727fe327d90660d4df42b875.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb498fa-e45b-58f3-9031-e12b9313f8d8/8fb498fa-e45b-58f3-9031-e12b9313f8d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_65be089a84f87c082d4cd6aae39610ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb498fa-e45b-58f3-9031-e12b9313f8d8/8fb498fa-e45b-58f3-9031-e12b9313f8d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_2826961ce00e84b0b19f3c8612e96d10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb498fa-e45b-58f3-9031-e12b9313f8d8/8fb498fa-e45b-58f3-9031-e12b9313f8d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_5c0f24fb05aac4b2ad5c379c79f8b86f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb498fa-e45b-58f3-9031-e12b9313f8d8/8fb498fa-e45b-58f3-9031-e12b9313f8d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_d580a621ab967b18a8dbf0a1b0b8096b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fb498fa-e45b-58f3-9031-e12b9313f8d8/8fb498fa-e45b-58f3-9031-e12b9313f8d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/22/eb22c513ed7745f63efae7035ae009a2/pa/WL17910_ce6dd392727fe327d90660d4df42b875.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [auto1.de] INFO: Saving data for WL17910: {'created_time': 1774675837.256262, 'last_price_update_time': 1774675837.256274, 'auction_closing_time': 1774714872.0}
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL17910') HTTP/1.1" 204 0
2026-03-28 05:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c7649a9-d267-516c-9baf-74c739405808 with identifier: VH56486
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 05:30:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c7649a9-d267-516c-9baf-74c739405808 with identifier: VH56486
2026-03-28 05:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c7649a9-d267-516c-9baf-74c739405808 with identifier: VH56486 to the API
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:34:20Z',
 'fuel_type': 'petrol',
 'id': '6c7649a9-d267-516c-9baf-74c739405808',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH56486',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 139146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-29',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 FSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH56486%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [auto1.de] INFO: Saving data for VH56486: {'auction_closing_time': 1774715660.0, 'created_time': 1773136839.834191, 'last_price_update_time': 1774675837.716397}
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH56486') HTTP/1.1" 204 0
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_3b452a578627a17fcae4e8b8b10d0f8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_3b452a578627a17fcae4e8b8b10d0f8a.jpg not downloaded yet
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_69e7c332fc310122ad4b6d8b4dc6f8bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_69e7c332fc310122ad4b6d8b4dc6f8bc.jpg not downloaded yet
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_7346d01fa1d478ff4034e9537291521e.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_7346d01fa1d478ff4034e9537291521e.jpg not downloaded yet
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [auto1.de] INFO: Scrape type for AL45510: 0
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [auto1.de] INFO: Scrape type for SB60272: 0
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: YL20431
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL20431%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [auto1.de] INFO: Scrape type for YL20431: 0
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [auto1.de] INFO: Scrape type for VT68593: 0
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [auto1.de] INFO: Scrape type for CW80278: 0
2026-03-28 05:30:37 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 9199 | hits on page: 40
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_6b7480a5b74e7dd8879a04ff192da4c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_6b7480a5b74e7dd8879a04ff192da4c5.jpg not downloaded yet
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_eb6a253ef0c634ce5d28deb168576fe0.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_eb6a253ef0c634ce5d28deb168576fe0.jpg not downloaded yet
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_455587a220003cdef412500d3b85b37f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_455587a220003cdef412500d3b85b37f.jpg not downloaded yet
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [auto1.de] INFO: Scrape type for HF86895: 0
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [auto1.de] INFO: Scrape type for TY58494: 0
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: NW08152
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [auto1.de] INFO: Scrape type for DL51973: 0
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: TY55023
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY55023%27 HTTP/1.1" 200 None
2026-03-28 05:30:37 [auto1.de] INFO: Scrape type for TY55023: 0
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: KR71178
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: PK60768
2026-03-28 05:30:37 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-28 05:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for NA89904: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: FK75470
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK75470%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for FK75470: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for CD75324: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for WV19329: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for FP33840: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: ZA94755
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for XC25059: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: EE06188
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE06188%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for EE06188: 2
2026-03-28 05:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47b70cd8-dba8-536e-a8f9-2f4c341853f7 with identifier: EE06188
2026-03-28 05:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47b70cd8-dba8-536e-a8f9-2f4c341853f7 with scrape type 2
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47b70cd8-dba8-536e-a8f9-2f4c341853f7 with scrape type 2
2026-03-28 05:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47b70cd8-dba8-536e-a8f9-2f4c341853f7, identifier: EE06188
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_eec65f21d44cd8854dcea5e10bbab471.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_eec65f21d44cd8854dcea5e10bbab471.jpg not downloaded yet
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_afffeaaf91e6837604962adc0496f109.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_afffeaaf91e6837604962adc0496f109.jpg not downloaded yet
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_85da4d456183b39a5bad5ba14bfefa8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_85da4d456183b39a5bad5ba14bfefa8c.jpg not downloaded yet
2026-03-28 05:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47b70cd8-dba8-536e-a8f9-2f4c341853f7 with identifier: EE06188
2026-03-28 05:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47b70cd8-dba8-536e-a8f9-2f4c341853f7 with identifier: EE06188
2026-03-28 05:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47b70cd8-dba8-536e-a8f9-2f4c341853f7 with identifier: EE06188 to the API
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:04:00Z',
 'fuel_type': 'diesel',
 'id': '47b70cd8-dba8-536e-a8f9-2f4c341853f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE06188',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 144265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 116 CDI lang Pro',
 'transmission': 'automatic',
 'trim': 'lang Pro',
 'year': 2015}
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE06188%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Saving data for EE06188: {'auction_closing_time': 1774713840.0, 'created_time': 1774550479.51428, 'last_price_update_time': 1774675838.590624}
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE06188') HTTP/1.1" 204 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for SM47095: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for KT07926: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: BM57132
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM57132%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for BM57132: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for SJ79213: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: LF00683
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF00683%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for LF00683: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for NY39865: 0
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-28 05:30:38 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [auto1.de] INFO: Scrape type for VL06718: 0
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_c33fceb17dd70cd8a34f7e713d7fe10c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_c33fceb17dd70cd8a34f7e713d7fe10c.jpg not downloaded yet
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_7f16ed7552bfac4d65f36ec94646bf57.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_7f16ed7552bfac4d65f36ec94646bf57.jpg not downloaded yet
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_af52cf93b394360672d51368b2edaf7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_af52cf93b394360672d51368b2edaf7d.jpg not downloaded yet
2026-03-28 05:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL09941/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA04600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR29564/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_da5f6511fdd211a5e55e7e2560df33a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_da5f6511fdd211a5e55e7e2560df33a8.jpg not downloaded yet
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_908a5344aaba82cf1a28e2b06133e486.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_908a5344aaba82cf1a28e2b06133e486.jpg not downloaded yet
2026-03-28 05:30:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_305fd49a07331757eaac44928c85b7d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_305fd49a07331757eaac44928c85b7d6.jpg not downloaded yet
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_739ebc1b91b6745cd89eb4ad2201fb2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_739ebc1b91b6745cd89eb4ad2201fb2c.jpg not downloaded yet
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_c8a3c9bea757002cbeec807e133741dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_c8a3c9bea757002cbeec807e133741dc.jpg not downloaded yet
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_43a9154030d86e86f3f08ffd0290efa9.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_43a9154030d86e86f3f08ffd0290efa9.jpg not downloaded yet
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_561fe003d0943fd3804ab58fce694787.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_561fe003d0943fd3804ab58fce694787.jpg not downloaded yet
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_710fb60fddd484ad80029ae7822b2d55.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_710fb60fddd484ad80029ae7822b2d55.jpg not downloaded yet
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_f1f8a0eb4deec0d9f9c1dea585461f22.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_f1f8a0eb4deec0d9f9c1dea585461f22.jpg not downloaded yet
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_9fa69bf182ea5bcc3f9fc97999737b83.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_ab7dd61ce7c040fa8bdf7e4829d91d66.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_b985307472630905b2d5bfb8148313ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_c33fceb17dd70cd8a34f7e713d7fe10c.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_f1f8a0eb4deec0d9f9c1dea585461f22.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_7f16ed7552bfac4d65f36ec94646bf57.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c0fa790>
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_9fa69bf182ea5bcc3f9fc97999737b83.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_9fa69bf182ea5bcc3f9fc97999737b83.jpg saved to cache
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f935c431-cf02-51e5-9b07-76168393dbfd
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c108490>
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_1.jpg HTTP/1.1" 201 0
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_ab7dd61ce7c040fa8bdf7e4829d91d66.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_ab7dd61ce7c040fa8bdf7e4829d91d66.jpg saved to cache
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9301628-71bd-55e5-9dce-82d4ff083f06
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_561fe003d0943fd3804ab58fce694787.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_64e28a833398758f5ebb38d8223fbe7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_2ebfd088995b450983494f1adb4710e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438ff23950>
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_0.jpg HTTP/1.1" 201 0
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_b985307472630905b2d5bfb8148313ef.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_b985307472630905b2d5bfb8148313ef.jpg saved to cache
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9301628-71bd-55e5-9dce-82d4ff083f06
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438ff81f50>
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_5.jpg HTTP/1.1" 201 0
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_c33fceb17dd70cd8a34f7e713d7fe10c.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_c33fceb17dd70cd8a34f7e713d7fe10c.jpg saved to cache
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9301628-71bd-55e5-9dce-82d4ff083f06
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438ffe3c10>
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_9.jpg HTTP/1.1" 201 0
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_f1f8a0eb4deec0d9f9c1dea585461f22.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_f1f8a0eb4deec0d9f9c1dea585461f22.jpg saved to cache
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f935c431-cf02-51e5-9b07-76168393dbfd
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c2204d0>
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_7f16ed7552bfac4d65f36ec94646bf57.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_7f16ed7552bfac4d65f36ec94646bf57.jpg saved to cache
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14fbc4be-d54e-5514-a2aa-511aa7bb79c8
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP45191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_7346d01fa1d478ff4034e9537291521e.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_43a9154030d86e86f3f08ffd0290efa9.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL26903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c2205d0>
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_9.jpg HTTP/1.1" 201 0
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_561fe003d0943fd3804ab58fce694787.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_561fe003d0943fd3804ab58fce694787.jpg saved to cache
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9301628-71bd-55e5-9dce-82d4ff083f06
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438ff5b4d0>
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_64e28a833398758f5ebb38d8223fbe7b.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_64e28a833398758f5ebb38d8223fbe7b.jpg saved to cache
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14fbc4be-d54e-5514-a2aa-511aa7bb79c8
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c0aa150>
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_2ebfd088995b450983494f1adb4710e4.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_2ebfd088995b450983494f1adb4710e4.jpg saved to cache
2026-03-28 05:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14fbc4be-d54e-5514-a2aa-511aa7bb79c8
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB21556/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c210390>
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_7346d01fa1d478ff4034e9537291521e.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_7346d01fa1d478ff4034e9537291521e.jpg saved to cache
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f935c431-cf02-51e5-9b07-76168393dbfd
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438ffaa150>
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_7.jpg HTTP/1.1" 201 0
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_43a9154030d86e86f3f08ffd0290efa9.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_43a9154030d86e86f3f08ffd0290efa9.jpg saved to cache
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f935c431-cf02-51e5-9b07-76168393dbfd
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_908a5344aaba82cf1a28e2b06133e486.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_85da4d456183b39a5bad5ba14bfefa8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_739ebc1b91b6745cd89eb4ad2201fb2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_af52cf93b394360672d51368b2edaf7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT47484> (referer: https://www.auto1.com/v1/car-details-view/JT47484/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS96565> (referer: https://www.auto1.com/v1/car-details-view/BS96565/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_710fb60fddd484ad80029ae7822b2d55.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_eb6a253ef0c634ce5d28deb168576fe0.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_da5f6511fdd211a5e55e7e2560df33a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_455587a220003cdef412500d3b85b37f.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_305fd49a07331757eaac44928c85b7d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_c8a3c9bea757002cbeec807e133741dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_eec65f21d44cd8854dcea5e10bbab471.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438ffbd0d0>
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_5.jpg HTTP/1.1" 201 0
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_908a5344aaba82cf1a28e2b06133e486.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_908a5344aaba82cf1a28e2b06133e486.jpg saved to cache
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f935c431-cf02-51e5-9b07-76168393dbfd
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438fe0fd90>
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_85da4d456183b39a5bad5ba14bfefa8c.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_85da4d456183b39a5bad5ba14bfefa8c.jpg saved to cache
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f935c431-cf02-51e5-9b07-76168393dbfd
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438fe31490>
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_6.jpg HTTP/1.1" 201 0
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_739ebc1b91b6745cd89eb4ad2201fb2c.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_739ebc1b91b6745cd89eb4ad2201fb2c.jpg saved to cache
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f935c431-cf02-51e5-9b07-76168393dbfd
2026-03-28 05:30:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439e3a97d0>
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_af52cf93b394360672d51368b2edaf7d.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_af52cf93b394360672d51368b2edaf7d.jpg saved to cache
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f935c431-cf02-51e5-9b07-76168393dbfd
2026-03-28 05:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2becf3a3-49ac-5f42-99cc-56b929f21377 with identifier: JT47484
2026-03-28 05:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2becf3a3-49ac-5f42-99cc-56b929f21377 with scrape type 1
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2becf3a3-49ac-5f42-99cc-56b929f21377
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Ff3%252F95f369a18a6b8f0f4f14a8b6bc31284f%252Fpa%252FJT47484_374b34f9437be4753dd2d7a4565d3423.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_374b34f9437be4753dd2d7a4565d3423.jpg already downloaded
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Ff3%252F95f369a18a6b8f0f4f14a8b6bc31284f%252Fpa%252FJT47484_127b508783318d1a8b954d361e8fac17.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_127b508783318d1a8b954d361e8fac17.jpg already downloaded
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Ff3%252F95f369a18a6b8f0f4f14a8b6bc31284f%252Fpa%252FJT47484_a2bd7d85a3c7c2149b4c378e332c9e3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_a2bd7d85a3c7c2149b4c378e332c9e3b.jpg already downloaded
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Ff3%252F95f369a18a6b8f0f4f14a8b6bc31284f%252Fpa%252FJT47484_775677b6c38cbb75fecf917b660a96d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_775677b6c38cbb75fecf917b660a96d8.jpg already downloaded
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Ff3%252F95f369a18a6b8f0f4f14a8b6bc31284f%252Fpa%252FJT47484_4f526ffdb827f0a6f54f50ad0ad2384d.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_4f526ffdb827f0a6f54f50ad0ad2384d.jpg already downloaded
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Ff3%252F95f369a18a6b8f0f4f14a8b6bc31284f%252Fpa%252FJT47484_50273139e6f66f9b64ca80f8a64c3760.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_50273139e6f66f9b64ca80f8a64c3760.jpg already downloaded
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Ff3%252F95f369a18a6b8f0f4f14a8b6bc31284f%252Fpa%252FJT47484_68026600f7af1654b26088b45536d9d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_68026600f7af1654b26088b45536d9d9.jpg already downloaded
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Ff3%252F95f369a18a6b8f0f4f14a8b6bc31284f%252Fpa%252FJT47484_01e443ab00bad5026860778340bb2e47.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_01e443ab00bad5026860778340bb2e47.jpg already downloaded
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Ff3%252F95f369a18a6b8f0f4f14a8b6bc31284f%252Fpa%252FJT47484_b9283d30b052e58ba3fde61d50b6b04f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_b9283d30b052e58ba3fde61d50b6b04f.jpg already downloaded
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Ff3%252F95f369a18a6b8f0f4f14a8b6bc31284f%252Fpa%252FJT47484_a79ab5b89faa316c7ef68b7b57d43861.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_a79ab5b89faa316c7ef68b7b57d43861.jpg already downloaded
2026-03-28 05:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2becf3a3-49ac-5f42-99cc-56b929f21377, identifier: JT47484
2026-03-28 05:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afa26326-fdc7-5abf-8722-d7007a83cb1b with identifier: BS96565
2026-03-28 05:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa26326-fdc7-5abf-8722-d7007a83cb1b with scrape type 1
2026-03-28 05:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item afa26326-fdc7-5abf-8722-d7007a83cb1b
2026-03-28 05:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca326e0bc56f3416277456f709f7cd3%252Fpa%252FBS96565_22ad599c1470324ea689af9767da01b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_22ad599c1470324ea689af9767da01b9.jpg already downloaded
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca326e0bc56f3416277456f709f7cd3%252Fpa%252FBS96565_70024f651a3a40c838e0e92263f181cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_70024f651a3a40c838e0e92263f181cb.jpg already downloaded
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca326e0bc56f3416277456f709f7cd3%252Fpa%252FBS96565_b507e0baf81fe06e49cf9b7792ecb2ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_b507e0baf81fe06e49cf9b7792ecb2ac.jpg already downloaded
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca326e0bc56f3416277456f709f7cd3%252Fpa%252FBS96565_1f397a27f998be416036183a222a5eea.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_1f397a27f998be416036183a222a5eea.jpg already downloaded
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca326e0bc56f3416277456f709f7cd3%252Fpa%252FBS96565_d61e7c130059a7d889234a918210a359.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_d61e7c130059a7d889234a918210a359.jpg already downloaded
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca326e0bc56f3416277456f709f7cd3%252Fpa%252FBS96565_e9436976fc6715bd3fa3fbd2fee5e58d.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_e9436976fc6715bd3fa3fbd2fee5e58d.jpg already downloaded
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca326e0bc56f3416277456f709f7cd3%252Fpa%252FBS96565_3985af6109cafa7e465d38c24eb51080.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_3985af6109cafa7e465d38c24eb51080.jpg already downloaded
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca326e0bc56f3416277456f709f7cd3%252Fpa%252FBS96565_1a2982a206025f05855fac9fbc3602d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_1a2982a206025f05855fac9fbc3602d4.jpg already downloaded
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca326e0bc56f3416277456f709f7cd3%252Fpa%252FBS96565_6766e0647f659ae80fea5ed78d1f699b.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_6766e0647f659ae80fea5ed78d1f699b.jpg already downloaded
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca326e0bc56f3416277456f709f7cd3%252Fpa%252FBS96565_2d0751d7ef1efe2a837b528932ff4511.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_2d0751d7ef1efe2a837b528932ff4511.jpg already downloaded
2026-03-28 05:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afa26326-fdc7-5abf-8722-d7007a83cb1b, identifier: BS96565
2026-03-28 05:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439e7f3c90>
2026-03-28 05:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_8.jpg HTTP/1.1" 201 0
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_710fb60fddd484ad80029ae7822b2d55.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_710fb60fddd484ad80029ae7822b2d55.jpg saved to cache
2026-03-28 05:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f935c431-cf02-51e5-9b07-76168393dbfd
2026-03-28 05:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2becf3a3-49ac-5f42-99cc-56b929f21377 with identifier: JT47484
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 05:30:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2becf3a3-49ac-5f42-99cc-56b929f21377 with identifier: JT47484
2026-03-28 05:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2becf3a3-49ac-5f42-99cc-56b929f21377 with identifier: JT47484 to the API
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JT47484>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:30:48Z',
 'fuel_type': 'petrol',
 'id': '2becf3a3-49ac-5f42-99cc-56b929f21377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT47484',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 21128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_374b34f9437be4753dd2d7a4565d3423.jpg',
                'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_127b508783318d1a8b954d361e8fac17.jpg',
                'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_a2bd7d85a3c7c2149b4c378e332c9e3b.jpg',
                'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_775677b6c38cbb75fecf917b660a96d8.jpg',
                'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_4f526ffdb827f0a6f54f50ad0ad2384d.jpg',
                'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_50273139e6f66f9b64ca80f8a64c3760.jpg',
                'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_68026600f7af1654b26088b45536d9d9.jpg',
                'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_01e443ab00bad5026860778340bb2e47.jpg',
                'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_b9283d30b052e58ba3fde61d50b6b04f.jpg',
                'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_a79ab5b89faa316c7ef68b7b57d43861.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2becf3a3-49ac-5f42-99cc-56b929f21377/2becf3a3-49ac-5f42-99cc-56b929f21377_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_374b34f9437be4753dd2d7a4565d3423.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2becf3a3-49ac-5f42-99cc-56b929f21377/2becf3a3-49ac-5f42-99cc-56b929f21377_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_127b508783318d1a8b954d361e8fac17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2becf3a3-49ac-5f42-99cc-56b929f21377/2becf3a3-49ac-5f42-99cc-56b929f21377_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_a2bd7d85a3c7c2149b4c378e332c9e3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2becf3a3-49ac-5f42-99cc-56b929f21377/2becf3a3-49ac-5f42-99cc-56b929f21377_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_775677b6c38cbb75fecf917b660a96d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2becf3a3-49ac-5f42-99cc-56b929f21377/2becf3a3-49ac-5f42-99cc-56b929f21377_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_4f526ffdb827f0a6f54f50ad0ad2384d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2becf3a3-49ac-5f42-99cc-56b929f21377/2becf3a3-49ac-5f42-99cc-56b929f21377_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_50273139e6f66f9b64ca80f8a64c3760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2becf3a3-49ac-5f42-99cc-56b929f21377/2becf3a3-49ac-5f42-99cc-56b929f21377_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_68026600f7af1654b26088b45536d9d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2becf3a3-49ac-5f42-99cc-56b929f21377/2becf3a3-49ac-5f42-99cc-56b929f21377_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_01e443ab00bad5026860778340bb2e47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2becf3a3-49ac-5f42-99cc-56b929f21377/2becf3a3-49ac-5f42-99cc-56b929f21377_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_b9283d30b052e58ba3fde61d50b6b04f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2becf3a3-49ac-5f42-99cc-56b929f21377/2becf3a3-49ac-5f42-99cc-56b929f21377_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/f3/95f369a18a6b8f0f4f14a8b6bc31284f/pa/JT47484_a79ab5b89faa316c7ef68b7b57d43861.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Suzuki Jimny 1.5 ALLGRIP Comfort+',
 'transmission': 'manual',
 'trim': 'ALLGRIP Comfort+',
 'year': 2021}
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-28 05:30:41 [auto1.de] INFO: Saving data for JT47484: {'created_time': 1774675841.80307, 'last_price_update_time': 1774675841.803079, 'auction_closing_time': 1774715448.0}
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT47484') HTTP/1.1" 204 0
2026-03-28 05:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afa26326-fdc7-5abf-8722-d7007a83cb1b with identifier: BS96565
2026-03-28 05:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afa26326-fdc7-5abf-8722-d7007a83cb1b with identifier: BS96565
2026-03-28 05:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afa26326-fdc7-5abf-8722-d7007a83cb1b with identifier: BS96565 to the API
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS96565>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:14:45Z',
 'fuel_type': 'petrol',
 'id': 'afa26326-fdc7-5abf-8722-d7007a83cb1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS96565',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 87638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_22ad599c1470324ea689af9767da01b9.jpg',
                'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_70024f651a3a40c838e0e92263f181cb.jpg',
                'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_b507e0baf81fe06e49cf9b7792ecb2ac.jpg',
                'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_1f397a27f998be416036183a222a5eea.jpg',
                'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_d61e7c130059a7d889234a918210a359.jpg',
                'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_e9436976fc6715bd3fa3fbd2fee5e58d.jpg',
                'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_3985af6109cafa7e465d38c24eb51080.jpg',
                'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_1a2982a206025f05855fac9fbc3602d4.jpg',
                'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_6766e0647f659ae80fea5ed78d1f699b.jpg',
                'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_2d0751d7ef1efe2a837b528932ff4511.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa26326-fdc7-5abf-8722-d7007a83cb1b/afa26326-fdc7-5abf-8722-d7007a83cb1b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_22ad599c1470324ea689af9767da01b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa26326-fdc7-5abf-8722-d7007a83cb1b/afa26326-fdc7-5abf-8722-d7007a83cb1b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_70024f651a3a40c838e0e92263f181cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa26326-fdc7-5abf-8722-d7007a83cb1b/afa26326-fdc7-5abf-8722-d7007a83cb1b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_b507e0baf81fe06e49cf9b7792ecb2ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa26326-fdc7-5abf-8722-d7007a83cb1b/afa26326-fdc7-5abf-8722-d7007a83cb1b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_1f397a27f998be416036183a222a5eea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa26326-fdc7-5abf-8722-d7007a83cb1b/afa26326-fdc7-5abf-8722-d7007a83cb1b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_d61e7c130059a7d889234a918210a359.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa26326-fdc7-5abf-8722-d7007a83cb1b/afa26326-fdc7-5abf-8722-d7007a83cb1b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_e9436976fc6715bd3fa3fbd2fee5e58d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa26326-fdc7-5abf-8722-d7007a83cb1b/afa26326-fdc7-5abf-8722-d7007a83cb1b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_3985af6109cafa7e465d38c24eb51080.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa26326-fdc7-5abf-8722-d7007a83cb1b/afa26326-fdc7-5abf-8722-d7007a83cb1b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_1a2982a206025f05855fac9fbc3602d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa26326-fdc7-5abf-8722-d7007a83cb1b/afa26326-fdc7-5abf-8722-d7007a83cb1b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_6766e0647f659ae80fea5ed78d1f699b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa26326-fdc7-5abf-8722-d7007a83cb1b/afa26326-fdc7-5abf-8722-d7007a83cb1b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca326e0bc56f3416277456f709f7cd3/pa/BS96565_2d0751d7ef1efe2a837b528932ff4511.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Vision 2WD',
 'transmission': 'automatic',
 'trim': 'Vision 2WD',
 'year': 2020}
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-28 05:30:42 [auto1.de] INFO: Saving data for BS96565: {'created_time': 1774675842.361821, 'last_price_update_time': 1774675842.361829, 'auction_closing_time': 1774714485.0}
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS96565') HTTP/1.1" 204 0
2026-03-28 05:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL09941> (referer: https://www.auto1.com/v1/car-details-view/XL09941/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR29564> (referer: https://www.auto1.com/v1/car-details-view/GR29564/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA04600> (referer: https://www.auto1.com/v1/car-details-view/RA04600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438ff22850>
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_eb6a253ef0c634ce5d28deb168576fe0.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_eb6a253ef0c634ce5d28deb168576fe0.jpg saved to cache
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14fbc4be-d54e-5514-a2aa-511aa7bb79c8
2026-03-28 05:30:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c126150>
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_6.jpg HTTP/1.1" 201 0
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_da5f6511fdd211a5e55e7e2560df33a8.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_da5f6511fdd211a5e55e7e2560df33a8.jpg saved to cache
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9301628-71bd-55e5-9dce-82d4ff083f06
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438fe3f190>
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Ff3%252Fbcf316eea6f2b92163247c3d44113164%252Fpa%252FMM43491_455587a220003cdef412500d3b85b37f.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_455587a220003cdef412500d3b85b37f.jpg saved to cache
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f935c431-cf02-51e5-9b07-76168393dbfd
2026-03-28 05:30:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f935c431-cf02-51e5-9b07-76168393dbfd, skipping ID generation
2026-03-28 05:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f935c431-cf02-51e5-9b07-76168393dbfd with scrape type 1
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f935c431-cf02-51e5-9b07-76168393dbfd sending to next pipeline
2026-03-28 05:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f935c431-cf02-51e5-9b07-76168393dbfd, identifier: MM43491
2026-03-28 05:30:42 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 9199 | hits on page: 40
2026-03-28 05:30:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c25a150>
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_7.jpg HTTP/1.1" 201 0
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_305fd49a07331757eaac44928c85b7d6.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_305fd49a07331757eaac44928c85b7d6.jpg saved to cache
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9301628-71bd-55e5-9dce-82d4ff083f06
2026-03-28 05:30:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438fe53610>
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_8.jpg HTTP/1.1" 201 0
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_c8a3c9bea757002cbeec807e133741dc.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_c8a3c9bea757002cbeec807e133741dc.jpg saved to cache
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9301628-71bd-55e5-9dce-82d4ff083f06
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438ff7d250>
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_4.jpg HTTP/1.1" 201 0
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_eec65f21d44cd8854dcea5e10bbab471.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_eec65f21d44cd8854dcea5e10bbab471.jpg saved to cache
2026-03-28 05:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9301628-71bd-55e5-9dce-82d4ff083f06
2026-03-28 05:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_afffeaaf91e6837604962adc0496f109.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f935c431-cf02-51e5-9b07-76168393dbfd with identifier: MM43491
2026-03-28 05:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f935c431-cf02-51e5-9b07-76168393dbfd with identifier: MM43491
2026-03-28 05:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f935c431-cf02-51e5-9b07-76168393dbfd with identifier: MM43491 to the API
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_455587a220003cdef412500d3b85b37f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:52:15Z',
 'fuel_type': 'petrol',
 'id': 'f935c431-cf02-51e5-9b07-76168393dbfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM43491',
 'listing': 'auction',
 'location': 'DE, Friedrichshafen',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 48058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_9fa69bf182ea5bcc3f9fc97999737b83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2510135,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_7346d01fa1d478ff4034e9537291521e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_455587a220003cdef412500d3b85b37f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_85da4d456183b39a5bad5ba14bfefa8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2530057,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_af52cf93b394360672d51368b2edaf7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_908a5344aaba82cf1a28e2b06133e486.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_739ebc1b91b6745cd89eb4ad2201fb2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_43a9154030d86e86f3f08ffd0290efa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2621073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_710fb60fddd484ad80029ae7822b2d55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f935c431-cf02-51e5-9b07-76168393dbfd/f935c431-cf02-51e5-9b07-76168393dbfd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/f3/bcf316eea6f2b92163247c3d44113164/pa/MM43491_f1f8a0eb4deec0d9f9c1dea585461f22.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2022}
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Saving data for MM43491: {'created_time': 1774675843.362134, 'last_price_update_time': 1774675843.362143, 'auction_closing_time': 1774716735.0}
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM43491') HTTP/1.1" 204 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for EJ52813: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for ZK29983: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for HP02844: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: LU01716
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: ES71771
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES71771%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for ES71771: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for PN07086: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: BL23866
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for MR23018: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: LW02583
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for ST29936: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: BC73900
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73900%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for BC73900: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for JA06342: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: CF34401
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for ND25281: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for VB56822: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: TJ50695
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: JB03080
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03080%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for JB03080: 0
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-28 05:30:43 [auto1.de] INFO: Found listing with ID: UK84754
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK84754%27 HTTP/1.1" 200 None
2026-03-28 05:30:43 [auto1.de] INFO: Scrape type for UK84754: 2
2026-03-28 05:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3e3fb4c-b066-52d8-8dee-4fba5639ce98 with identifier: UK84754
2026-03-28 05:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3e3fb4c-b066-52d8-8dee-4fba5639ce98 with scrape type 2
2026-03-28 05:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3e3fb4c-b066-52d8-8dee-4fba5639ce98 with scrape type 2
2026-03-28 05:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3e3fb4c-b066-52d8-8dee-4fba5639ce98, identifier: UK84754
2026-03-28 05:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3e3fb4c-b066-52d8-8dee-4fba5639ce98 with identifier: UK84754
2026-03-28 05:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3e3fb4c-b066-52d8-8dee-4fba5639ce98 with identifier: UK84754
2026-03-28 05:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3e3fb4c-b066-52d8-8dee-4fba5639ce98 with identifier: UK84754 to the API
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:37:36Z',
 'fuel_type': 'diesel',
 'id': 'e3e3fb4c-b066-52d8-8dee-4fba5639ce98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK84754',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 163727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-04',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Sound',
 'transmission': 'manual',
 'trim': 'Sound',
 'year': 2017}
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK84754%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [auto1.de] INFO: Saving data for UK84754: {'auction_closing_time': 1774715856.0, 'created_time': 1774552448.229421, 'last_price_update_time': 1774675844.066651}
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK84754') HTTP/1.1" 204 0
2026-03-28 05:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP45191> (referer: https://www.auto1.com/v1/car-details-view/GP45191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL26903> (referer: https://www.auto1.com/v1/car-details-view/AL26903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 566b4db3-3aee-5b02-b49d-d92e5f66b177 with identifier: XL09941
2026-03-28 05:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 566b4db3-3aee-5b02-b49d-d92e5f66b177 with scrape type 1
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 566b4db3-3aee-5b02-b49d-d92e5f66b177
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fac%252F9fac80782b28da2d85ed9aaf9d6421f7%252Fpa%252FXL09941_f119363bc6884d34780b0c5cc2a0d0e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_f119363bc6884d34780b0c5cc2a0d0e4.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fac%252F9fac80782b28da2d85ed9aaf9d6421f7%252Fpa%252FXL09941_e61c73b117288143cebe16765a185e0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_e61c73b117288143cebe16765a185e0b.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fac%252F9fac80782b28da2d85ed9aaf9d6421f7%252Fpa%252FXL09941_192516d4a87c4a88fcb5e66ca18ca4d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_192516d4a87c4a88fcb5e66ca18ca4d3.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fac%252F9fac80782b28da2d85ed9aaf9d6421f7%252Fpa%252FXL09941_00129ef8827881e677d7630a479b85a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_00129ef8827881e677d7630a479b85a6.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fac%252F9fac80782b28da2d85ed9aaf9d6421f7%252Fpa%252FXL09941_f796144e0ebbef11c7917f0072e3e702.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_f796144e0ebbef11c7917f0072e3e702.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fac%252F9fac80782b28da2d85ed9aaf9d6421f7%252Fpa%252FXL09941_b75580038cdbee36164243bde004efdf.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_b75580038cdbee36164243bde004efdf.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fac%252F9fac80782b28da2d85ed9aaf9d6421f7%252Fpa%252FXL09941_78e6ad2f9db320ed6cf879a06e15f10f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_78e6ad2f9db320ed6cf879a06e15f10f.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fac%252F9fac80782b28da2d85ed9aaf9d6421f7%252Fpa%252FXL09941_1de826e1317dff1a0a42134f5c3aaef0.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_1de826e1317dff1a0a42134f5c3aaef0.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fac%252F9fac80782b28da2d85ed9aaf9d6421f7%252Fpa%252FXL09941_156eabecf6b43644de6ef3967e1bf92f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_156eabecf6b43644de6ef3967e1bf92f.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fac%252F9fac80782b28da2d85ed9aaf9d6421f7%252Fpa%252FXL09941_499e6128f77a1b2691284e4072958e22.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_499e6128f77a1b2691284e4072958e22.jpg already downloaded
2026-03-28 05:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 566b4db3-3aee-5b02-b49d-d92e5f66b177, identifier: XL09941
2026-03-28 05:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2746d8c-1505-511a-bb7b-066a4eff25be with identifier: GR29564
2026-03-28 05:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2746d8c-1505-511a-bb7b-066a4eff25be with scrape type 1
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e2746d8c-1505-511a-bb7b-066a4eff25be
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fa9%252F7ca9925532e9a5ebd8b608db1d0f9499%252Fpa%252FGR29564_3c959f0b16491e81560e622848bebd94.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_3c959f0b16491e81560e622848bebd94.jpg not downloaded yet
2026-03-28 05:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd0773d3-7848-596f-a726-9313d9385e89 with identifier: RA04600
2026-03-28 05:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd0773d3-7848-596f-a726-9313d9385e89 with scrape type 1
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd0773d3-7848-596f-a726-9313d9385e89
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fa2%252F07a2cdb1ce4c6de3b8d892026114ca07%252Fpa%252FRA04600_49ebab26f3633cf3f47854cc3ad05f70.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_49ebab26f3633cf3f47854cc3ad05f70.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fa2%252F07a2cdb1ce4c6de3b8d892026114ca07%252Fpa%252FRA04600_3739c5f8c17367440b86a7c0905afc4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_3739c5f8c17367440b86a7c0905afc4c.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fa2%252F07a2cdb1ce4c6de3b8d892026114ca07%252Fpa%252FRA04600_654c29c7b8c784514674ddcd4c54ba3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_654c29c7b8c784514674ddcd4c54ba3b.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fa2%252F07a2cdb1ce4c6de3b8d892026114ca07%252Fpa%252FRA04600_640ceea4bdd7b2ec7fd2820079ea8146.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_640ceea4bdd7b2ec7fd2820079ea8146.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fa2%252F07a2cdb1ce4c6de3b8d892026114ca07%252Fpa%252FRA04600_d157305c5093aad61b2b09a3b3dc325f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_d157305c5093aad61b2b09a3b3dc325f.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fa2%252F07a2cdb1ce4c6de3b8d892026114ca07%252Fpa%252FRA04600_c1e59073086fac2b5f5ca773ce4dc4bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_c1e59073086fac2b5f5ca773ce4dc4bc.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fa2%252F07a2cdb1ce4c6de3b8d892026114ca07%252Fpa%252FRA04600_688597a77a36a534b9dadab72f190cb9.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_688597a77a36a534b9dadab72f190cb9.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fa2%252F07a2cdb1ce4c6de3b8d892026114ca07%252Fpa%252FRA04600_8dfafc6e35facc62f95df20239eaee23.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_8dfafc6e35facc62f95df20239eaee23.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fa2%252F07a2cdb1ce4c6de3b8d892026114ca07%252Fpa%252FRA04600_538572ee63e13bc5239a59445ae008e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_538572ee63e13bc5239a59445ae008e0.jpg already downloaded
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fa2%252F07a2cdb1ce4c6de3b8d892026114ca07%252Fpa%252FRA04600_6c84c2942b45f481d18741b152e71979.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_6c84c2942b45f481d18741b152e71979.jpg already downloaded
2026-03-28 05:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd0773d3-7848-596f-a726-9313d9385e89, identifier: RA04600
2026-03-28 05:30:44 [auto1.de] INFO: Found listing with ID: BX84490
2026-03-28 05:30:44 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-28 05:30:44 [auto1.de] INFO: Scrape type for GC82813: 0
2026-03-28 05:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF38330> (referer: https://www.auto1.com/v1/car-details-view/NF38330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 566b4db3-3aee-5b02-b49d-d92e5f66b177 with identifier: XL09941
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 05:30:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 566b4db3-3aee-5b02-b49d-d92e5f66b177 with identifier: XL09941
2026-03-28 05:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 566b4db3-3aee-5b02-b49d-d92e5f66b177 with identifier: XL09941 to the API
2026-03-28 05:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XL09941>
{'auction_title': '',
 'c_o_2_emission_value': 245,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 212,
 'expiration_date': '2026-03-28T16:31:05Z',
 'fuel_type': 'diesel',
 'id': '566b4db3-3aee-5b02-b49d-d92e5f66b177',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL09941',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 119230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_f119363bc6884d34780b0c5cc2a0d0e4.jpg',
                'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_e61c73b117288143cebe16765a185e0b.jpg',
                'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_192516d4a87c4a88fcb5e66ca18ca4d3.jpg',
                'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_00129ef8827881e677d7630a479b85a6.jpg',
                'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_f796144e0ebbef11c7917f0072e3e702.jpg',
                'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_b75580038cdbee36164243bde004efdf.jpg',
                'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_78e6ad2f9db320ed6cf879a06e15f10f.jpg',
                'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_1de826e1317dff1a0a42134f5c3aaef0.jpg',
                'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_156eabecf6b43644de6ef3967e1bf92f.jpg',
                'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_499e6128f77a1b2691284e4072958e22.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566b4db3-3aee-5b02-b49d-d92e5f66b177/566b4db3-3aee-5b02-b49d-d92e5f66b177_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_f119363bc6884d34780b0c5cc2a0d0e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566b4db3-3aee-5b02-b49d-d92e5f66b177/566b4db3-3aee-5b02-b49d-d92e5f66b177_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_e61c73b117288143cebe16765a185e0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566b4db3-3aee-5b02-b49d-d92e5f66b177/566b4db3-3aee-5b02-b49d-d92e5f66b177_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_192516d4a87c4a88fcb5e66ca18ca4d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566b4db3-3aee-5b02-b49d-d92e5f66b177/566b4db3-3aee-5b02-b49d-d92e5f66b177_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_00129ef8827881e677d7630a479b85a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566b4db3-3aee-5b02-b49d-d92e5f66b177/566b4db3-3aee-5b02-b49d-d92e5f66b177_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_f796144e0ebbef11c7917f0072e3e702.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566b4db3-3aee-5b02-b49d-d92e5f66b177/566b4db3-3aee-5b02-b49d-d92e5f66b177_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_b75580038cdbee36164243bde004efdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566b4db3-3aee-5b02-b49d-d92e5f66b177/566b4db3-3aee-5b02-b49d-d92e5f66b177_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_78e6ad2f9db320ed6cf879a06e15f10f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566b4db3-3aee-5b02-b49d-d92e5f66b177/566b4db3-3aee-5b02-b49d-d92e5f66b177_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_1de826e1317dff1a0a42134f5c3aaef0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566b4db3-3aee-5b02-b49d-d92e5f66b177/566b4db3-3aee-5b02-b49d-d92e5f66b177_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_156eabecf6b43644de6ef3967e1bf92f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566b4db3-3aee-5b02-b49d-d92e5f66b177/566b4db3-3aee-5b02-b49d-d92e5f66b177_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/ac/9fac80782b28da2d85ed9aaf9d6421f7/pa/XL09941_499e6128f77a1b2691284e4072958e22.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2019}
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL09941%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [auto1.de] INFO: Saving data for XL09941: {'created_time': 1774675845.177503, 'last_price_update_time': 1774675845.177513, 'auction_closing_time': 1774715465.0}
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL09941') HTTP/1.1" 204 0
2026-03-28 05:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd0773d3-7848-596f-a726-9313d9385e89 with identifier: RA04600
2026-03-28 05:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd0773d3-7848-596f-a726-9313d9385e89 with identifier: RA04600
2026-03-28 05:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd0773d3-7848-596f-a726-9313d9385e89 with identifier: RA04600 to the API
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA04600>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:38:10Z',
 'fuel_type': 'diesel',
 'id': 'bd0773d3-7848-596f-a726-9313d9385e89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA04600',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 200199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_49ebab26f3633cf3f47854cc3ad05f70.jpg',
                'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_3739c5f8c17367440b86a7c0905afc4c.jpg',
                'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_654c29c7b8c784514674ddcd4c54ba3b.jpg',
                'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_640ceea4bdd7b2ec7fd2820079ea8146.jpg',
                'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_d157305c5093aad61b2b09a3b3dc325f.jpg',
                'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_c1e59073086fac2b5f5ca773ce4dc4bc.jpg',
                'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_688597a77a36a534b9dadab72f190cb9.jpg',
                'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_8dfafc6e35facc62f95df20239eaee23.jpg',
                'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_538572ee63e13bc5239a59445ae008e0.jpg',
                'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_6c84c2942b45f481d18741b152e71979.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0773d3-7848-596f-a726-9313d9385e89/bd0773d3-7848-596f-a726-9313d9385e89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_49ebab26f3633cf3f47854cc3ad05f70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0773d3-7848-596f-a726-9313d9385e89/bd0773d3-7848-596f-a726-9313d9385e89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_3739c5f8c17367440b86a7c0905afc4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0773d3-7848-596f-a726-9313d9385e89/bd0773d3-7848-596f-a726-9313d9385e89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_654c29c7b8c784514674ddcd4c54ba3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0773d3-7848-596f-a726-9313d9385e89/bd0773d3-7848-596f-a726-9313d9385e89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_640ceea4bdd7b2ec7fd2820079ea8146.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0773d3-7848-596f-a726-9313d9385e89/bd0773d3-7848-596f-a726-9313d9385e89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_d157305c5093aad61b2b09a3b3dc325f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0773d3-7848-596f-a726-9313d9385e89/bd0773d3-7848-596f-a726-9313d9385e89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_c1e59073086fac2b5f5ca773ce4dc4bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0773d3-7848-596f-a726-9313d9385e89/bd0773d3-7848-596f-a726-9313d9385e89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_688597a77a36a534b9dadab72f190cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0773d3-7848-596f-a726-9313d9385e89/bd0773d3-7848-596f-a726-9313d9385e89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_8dfafc6e35facc62f95df20239eaee23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0773d3-7848-596f-a726-9313d9385e89/bd0773d3-7848-596f-a726-9313d9385e89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_538572ee63e13bc5239a59445ae008e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0773d3-7848-596f-a726-9313d9385e89/bd0773d3-7848-596f-a726-9313d9385e89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/a2/07a2cdb1ce4c6de3b8d892026114ca07/pa/RA04600_6c84c2942b45f481d18741b152e71979.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 Allroad 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [auto1.de] INFO: Saving data for RA04600: {'created_time': 1774675845.51671, 'last_price_update_time': 1774675845.516725, 'auction_closing_time': 1774715890.0}
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA04600') HTTP/1.1" 204 0
2026-03-28 05:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438ff53990>
2026-03-28 05:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_afffeaaf91e6837604962adc0496f109.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_afffeaaf91e6837604962adc0496f109.jpg saved to cache
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14fbc4be-d54e-5514-a2aa-511aa7bb79c8
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fa9%252F7ca9925532e9a5ebd8b608db1d0f9499%252Fpa%252FGR29564_2f1e9d90ab08e7616f28116002dcb034.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_2f1e9d90ab08e7616f28116002dcb034.jpg not downloaded yet
2026-03-28 05:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB21556> (referer: https://www.auto1.com/v1/car-details-view/XB21556/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c796b2cb-6102-53c1-be7b-c07fefb50e84 with identifier: GP45191
2026-03-28 05:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c796b2cb-6102-53c1-be7b-c07fefb50e84 with scrape type 1
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c796b2cb-6102-53c1-be7b-c07fefb50e84
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fff%252F52ff53b3d081bc9857744b7c71ede268%252Fpa%252FGP45191_9acce9f24cf1d67b6fd9e62c40e80b98.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_9acce9f24cf1d67b6fd9e62c40e80b98.jpg not downloaded yet
2026-03-28 05:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db6e045d-d9f0-531b-ab7e-f61715115c8c with identifier: AL26903
2026-03-28 05:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db6e045d-d9f0-531b-ab7e-f61715115c8c with scrape type 1
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db6e045d-d9f0-531b-ab7e-f61715115c8c
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F80%252F14802b198ded61e27cf6ce9460c5aac0%252Fpa%252FAL26903_ac837584c066bd38f0d422157aabce8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_ac837584c066bd38f0d422157aabce8b.jpg already downloaded
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F80%252F14802b198ded61e27cf6ce9460c5aac0%252Fpa%252FAL26903_a69ddec94df8e402baa917db38f6deef.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_a69ddec94df8e402baa917db38f6deef.jpg already downloaded
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F80%252F14802b198ded61e27cf6ce9460c5aac0%252Fpa%252FAL26903_196c7237b3ad1593576898e2589f07c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_196c7237b3ad1593576898e2589f07c2.jpg already downloaded
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F80%252F14802b198ded61e27cf6ce9460c5aac0%252Fpa%252FAL26903_8daeab37a521b11e8b888b4a5999c360.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_8daeab37a521b11e8b888b4a5999c360.jpg already downloaded
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F80%252F14802b198ded61e27cf6ce9460c5aac0%252Fpa%252FAL26903_ff54ed97e7bf796f3b6768d4c1740d71.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_ff54ed97e7bf796f3b6768d4c1740d71.jpg already downloaded
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F80%252F14802b198ded61e27cf6ce9460c5aac0%252Fpa%252FAL26903_8cd30e05864db3557081855a8080f934.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_8cd30e05864db3557081855a8080f934.jpg already downloaded
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F80%252F14802b198ded61e27cf6ce9460c5aac0%252Fpa%252FAL26903_9517b6d3e83d8fbb5227ff28bfe13760.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_9517b6d3e83d8fbb5227ff28bfe13760.jpg already downloaded
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F80%252F14802b198ded61e27cf6ce9460c5aac0%252Fpa%252FAL26903_85e2c2e328268f067ef9f94b83862abb.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_85e2c2e328268f067ef9f94b83862abb.jpg already downloaded
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F80%252F14802b198ded61e27cf6ce9460c5aac0%252Fpa%252FAL26903_6d6c5a8e6fb436fc8d26aa1f7596cb5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_6d6c5a8e6fb436fc8d26aa1f7596cb5c.jpg already downloaded
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F80%252F14802b198ded61e27cf6ce9460c5aac0%252Fpa%252FAL26903_eff78969a662d71635d63a1848a8bb93.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_eff78969a662d71635d63a1848a8bb93.jpg already downloaded
2026-03-28 05:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db6e045d-d9f0-531b-ab7e-f61715115c8c, identifier: AL26903
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fa9%252F7ca9925532e9a5ebd8b608db1d0f9499%252Fpa%252FGR29564_0ffa7c0e12448bd9cb838920d76b90ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_0ffa7c0e12448bd9cb838920d76b90ab.jpg not downloaded yet
2026-03-28 05:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db6e045d-d9f0-531b-ab7e-f61715115c8c with identifier: AL26903
2026-03-28 05:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db6e045d-d9f0-531b-ab7e-f61715115c8c with identifier: AL26903
2026-03-28 05:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db6e045d-d9f0-531b-ab7e-f61715115c8c with identifier: AL26903 to the API
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL26903>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:22:30Z',
 'fuel_type': 'diesel',
 'id': 'db6e045d-d9f0-531b-ab7e-f61715115c8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL26903',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 92673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_ac837584c066bd38f0d422157aabce8b.jpg',
                'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_a69ddec94df8e402baa917db38f6deef.jpg',
                'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_196c7237b3ad1593576898e2589f07c2.jpg',
                'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_8daeab37a521b11e8b888b4a5999c360.jpg',
                'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_ff54ed97e7bf796f3b6768d4c1740d71.jpg',
                'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_8cd30e05864db3557081855a8080f934.jpg',
                'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_9517b6d3e83d8fbb5227ff28bfe13760.jpg',
                'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_85e2c2e328268f067ef9f94b83862abb.jpg',
                'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_6d6c5a8e6fb436fc8d26aa1f7596cb5c.jpg',
                'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_eff78969a662d71635d63a1848a8bb93.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6e045d-d9f0-531b-ab7e-f61715115c8c/db6e045d-d9f0-531b-ab7e-f61715115c8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3117205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_ac837584c066bd38f0d422157aabce8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6e045d-d9f0-531b-ab7e-f61715115c8c/db6e045d-d9f0-531b-ab7e-f61715115c8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3098035,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_a69ddec94df8e402baa917db38f6deef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6e045d-d9f0-531b-ab7e-f61715115c8c/db6e045d-d9f0-531b-ab7e-f61715115c8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2964789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_196c7237b3ad1593576898e2589f07c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6e045d-d9f0-531b-ab7e-f61715115c8c/db6e045d-d9f0-531b-ab7e-f61715115c8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2985206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_8daeab37a521b11e8b888b4a5999c360.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6e045d-d9f0-531b-ab7e-f61715115c8c/db6e045d-d9f0-531b-ab7e-f61715115c8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008034,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_ff54ed97e7bf796f3b6768d4c1740d71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6e045d-d9f0-531b-ab7e-f61715115c8c/db6e045d-d9f0-531b-ab7e-f61715115c8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_8cd30e05864db3557081855a8080f934.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6e045d-d9f0-531b-ab7e-f61715115c8c/db6e045d-d9f0-531b-ab7e-f61715115c8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2924389,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_9517b6d3e83d8fbb5227ff28bfe13760.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6e045d-d9f0-531b-ab7e-f61715115c8c/db6e045d-d9f0-531b-ab7e-f61715115c8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_85e2c2e328268f067ef9f94b83862abb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6e045d-d9f0-531b-ab7e-f61715115c8c/db6e045d-d9f0-531b-ab7e-f61715115c8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_6d6c5a8e6fb436fc8d26aa1f7596cb5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6e045d-d9f0-531b-ab7e-f61715115c8c/db6e045d-d9f0-531b-ab7e-f61715115c8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2814158,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/80/14802b198ded61e27cf6ce9460c5aac0/pa/AL26903_eff78969a662d71635d63a1848a8bb93.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Overland 4WD',
 'transmission': 'automatic',
 'trim': 'Overland 4WD',
 'year': 2018}
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [auto1.de] INFO: Saving data for AL26903: {'created_time': 1774675846.310387, 'last_price_update_time': 1774675846.310397, 'auction_closing_time': 1774714950.0}
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL26903') HTTP/1.1" 204 0
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fff%252F52ff53b3d081bc9857744b7c71ede268%252Fpa%252FGP45191_af3cf8b1af67e581a54cfd23ec96ff78.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_af3cf8b1af67e581a54cfd23ec96ff78.jpg not downloaded yet
2026-03-28 05:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f8087f-cbe4-5fbb-96aa-e89f85f016c7 with identifier: NF38330
2026-03-28 05:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f8087f-cbe4-5fbb-96aa-e89f85f016c7 with scrape type 1
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17f8087f-cbe4-5fbb-96aa-e89f85f016c7
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fed%252Ff3ed4316b8d430c1875efbc7b4d5b8c1%252Fpa%252FNF38330_7bc2de86287d1d36b026c10dc836d0d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_7bc2de86287d1d36b026c10dc836d0d2.jpg already downloaded
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fed%252Ff3ed4316b8d430c1875efbc7b4d5b8c1%252Fpa%252FNF38330_8fbe8f3e542a452fb57b42aec724bcac.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_8fbe8f3e542a452fb57b42aec724bcac.jpg already downloaded
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fed%252Ff3ed4316b8d430c1875efbc7b4d5b8c1%252Fpa%252FNF38330_aa9b658a651dc6f159342c5ff7dc8616.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_aa9b658a651dc6f159342c5ff7dc8616.jpg already downloaded
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fed%252Ff3ed4316b8d430c1875efbc7b4d5b8c1%252Fpa%252FNF38330_d387ba11af1c8ba2032198bcfa076e75.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_d387ba11af1c8ba2032198bcfa076e75.jpg already downloaded
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fed%252Ff3ed4316b8d430c1875efbc7b4d5b8c1%252Fpa%252FNF38330_a0b498e468625fc9d7c6287922da78c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_a0b498e468625fc9d7c6287922da78c8.jpg already downloaded
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fed%252Ff3ed4316b8d430c1875efbc7b4d5b8c1%252Fpa%252FNF38330_70142df827d7f444dac5deb31e33449d.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_70142df827d7f444dac5deb31e33449d.jpg already downloaded
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fed%252Ff3ed4316b8d430c1875efbc7b4d5b8c1%252Fpa%252FNF38330_39644574596a0555f48da8d54193528a.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_39644574596a0555f48da8d54193528a.jpg already downloaded
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fed%252Ff3ed4316b8d430c1875efbc7b4d5b8c1%252Fpa%252FNF38330_8ea85bcb04614c89d1266e10c7d1d5f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_8ea85bcb04614c89d1266e10c7d1d5f6.jpg already downloaded
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fed%252Ff3ed4316b8d430c1875efbc7b4d5b8c1%252Fpa%252FNF38330_0126ac4aa68ed1e98786ef8062f7f74b.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_0126ac4aa68ed1e98786ef8062f7f74b.jpg already downloaded
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fed%252Ff3ed4316b8d430c1875efbc7b4d5b8c1%252Fpa%252FNF38330_10cac377808978252027b020dbaf8ecd.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_10cac377808978252027b020dbaf8ecd.jpg already downloaded
2026-03-28 05:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17f8087f-cbe4-5fbb-96aa-e89f85f016c7, identifier: NF38330
2026-03-28 05:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_69e7c332fc310122ad4b6d8b4dc6f8bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fa9%252F7ca9925532e9a5ebd8b608db1d0f9499%252Fpa%252FGR29564_f435739b67759b136d42db286854b50d.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_f435739b67759b136d42db286854b50d.jpg not downloaded yet
2026-03-28 05:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17f8087f-cbe4-5fbb-96aa-e89f85f016c7 with identifier: NF38330
2026-03-28 05:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17f8087f-cbe4-5fbb-96aa-e89f85f016c7 with identifier: NF38330
2026-03-28 05:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17f8087f-cbe4-5fbb-96aa-e89f85f016c7 with identifier: NF38330 to the API
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF38330>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:43:01Z',
 'fuel_type': 'petrol',
 'id': '17f8087f-cbe4-5fbb-96aa-e89f85f016c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF38330',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 99812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_7bc2de86287d1d36b026c10dc836d0d2.jpg',
                'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_8fbe8f3e542a452fb57b42aec724bcac.jpg',
                'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_aa9b658a651dc6f159342c5ff7dc8616.jpg',
                'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_d387ba11af1c8ba2032198bcfa076e75.jpg',
                'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_a0b498e468625fc9d7c6287922da78c8.jpg',
                'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_70142df827d7f444dac5deb31e33449d.jpg',
                'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_39644574596a0555f48da8d54193528a.jpg',
                'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_8ea85bcb04614c89d1266e10c7d1d5f6.jpg',
                'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_0126ac4aa68ed1e98786ef8062f7f74b.jpg',
                'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_10cac377808978252027b020dbaf8ecd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f8087f-cbe4-5fbb-96aa-e89f85f016c7/17f8087f-cbe4-5fbb-96aa-e89f85f016c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_7bc2de86287d1d36b026c10dc836d0d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f8087f-cbe4-5fbb-96aa-e89f85f016c7/17f8087f-cbe4-5fbb-96aa-e89f85f016c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2241857,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_8fbe8f3e542a452fb57b42aec724bcac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f8087f-cbe4-5fbb-96aa-e89f85f016c7/17f8087f-cbe4-5fbb-96aa-e89f85f016c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_aa9b658a651dc6f159342c5ff7dc8616.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f8087f-cbe4-5fbb-96aa-e89f85f016c7/17f8087f-cbe4-5fbb-96aa-e89f85f016c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2201824,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_d387ba11af1c8ba2032198bcfa076e75.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f8087f-cbe4-5fbb-96aa-e89f85f016c7/17f8087f-cbe4-5fbb-96aa-e89f85f016c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_a0b498e468625fc9d7c6287922da78c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f8087f-cbe4-5fbb-96aa-e89f85f016c7/17f8087f-cbe4-5fbb-96aa-e89f85f016c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_70142df827d7f444dac5deb31e33449d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f8087f-cbe4-5fbb-96aa-e89f85f016c7/17f8087f-cbe4-5fbb-96aa-e89f85f016c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_39644574596a0555f48da8d54193528a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f8087f-cbe4-5fbb-96aa-e89f85f016c7/17f8087f-cbe4-5fbb-96aa-e89f85f016c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_8ea85bcb04614c89d1266e10c7d1d5f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f8087f-cbe4-5fbb-96aa-e89f85f016c7/17f8087f-cbe4-5fbb-96aa-e89f85f016c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_0126ac4aa68ed1e98786ef8062f7f74b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f8087f-cbe4-5fbb-96aa-e89f85f016c7/17f8087f-cbe4-5fbb-96aa-e89f85f016c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/ed/f3ed4316b8d430c1875efbc7b4d5b8c1/pa/NF38330_10cac377808978252027b020dbaf8ecd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 1.4 TFSI ACT',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [auto1.de] INFO: Saving data for NF38330: {'created_time': 1774675846.960755, 'last_price_update_time': 1774675846.960764, 'auction_closing_time': 1774716181.0}
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF38330') HTTP/1.1" 204 0
2026-03-28 05:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915 with identifier: XB21556
2026-03-28 05:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915 with scrape type 1
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_426a2791226a3ece5eed077eb623b7e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_426a2791226a3ece5eed077eb623b7e5.jpg not downloaded yet
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fff%252F52ff53b3d081bc9857744b7c71ede268%252Fpa%252FGP45191_751b1ccd2c5965f1bb05a2bf67ac9e44.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_751b1ccd2c5965f1bb05a2bf67ac9e44.jpg not downloaded yet
2026-03-28 05:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_3c959f0b16491e81560e622848bebd94.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fa9%252F7ca9925532e9a5ebd8b608db1d0f9499%252Fpa%252FGR29564_cff45db9a95172c6a04502edab78003d.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_cff45db9a95172c6a04502edab78003d.jpg not downloaded yet
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_a3c3c4ffdb53fff23be9d533f1758bdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_a3c3c4ffdb53fff23be9d533f1758bdd.jpg not downloaded yet
2026-03-28 05:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_2f1e9d90ab08e7616f28116002dcb034.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fff%252F52ff53b3d081bc9857744b7c71ede268%252Fpa%252FGP45191_f1efc3655ae1b11b15297f376b56fffc.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_f1efc3655ae1b11b15297f376b56fffc.jpg not downloaded yet
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439e3ab790>
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe2%252F83e28b794e070184bf54c998def601b8%252Fpa%252FNP38259_69e7c332fc310122ad4b6d8b4dc6f8bc.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_69e7c332fc310122ad4b6d8b4dc6f8bc.jpg saved to cache
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14fbc4be-d54e-5514-a2aa-511aa7bb79c8
2026-03-28 05:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14fbc4be-d54e-5514-a2aa-511aa7bb79c8, skipping ID generation
2026-03-28 05:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14fbc4be-d54e-5514-a2aa-511aa7bb79c8 with scrape type 1
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14fbc4be-d54e-5514-a2aa-511aa7bb79c8 sending to next pipeline
2026-03-28 05:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14fbc4be-d54e-5514-a2aa-511aa7bb79c8, identifier: NP38259
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_71e645a0df1d02f112a1cfcc514d4762.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_71e645a0df1d02f112a1cfcc514d4762.jpg not downloaded yet
2026-03-28 05:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14fbc4be-d54e-5514-a2aa-511aa7bb79c8 with identifier: NP38259
2026-03-28 05:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14fbc4be-d54e-5514-a2aa-511aa7bb79c8 with identifier: NP38259
2026-03-28 05:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14fbc4be-d54e-5514-a2aa-511aa7bb79c8 with identifier: NP38259 to the API
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_69e7c332fc310122ad4b6d8b4dc6f8bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:48:10Z',
 'fuel_type': 'petrol',
 'id': '14fbc4be-d54e-5514-a2aa-511aa7bb79c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP38259',
 'listing': 'auction',
 'location': 'DE, Erfurt',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 197134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_64e28a833398758f5ebb38d8223fbe7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_2ebfd088995b450983494f1adb4710e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_69e7c332fc310122ad4b6d8b4dc6f8bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_eb6a253ef0c634ce5d28deb168576fe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_afffeaaf91e6837604962adc0496f109.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14fbc4be-d54e-5514-a2aa-511aa7bb79c8/14fbc4be-d54e-5514-a2aa-511aa7bb79c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/e2/83e28b794e070184bf54c998def601b8/pa/NP38259_7f16ed7552bfac4d65f36ec94646bf57.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.8 VTEC Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP38259%27 HTTP/1.1" 200 None
2026-03-28 05:30:47 [auto1.de] INFO: Saving data for NP38259: {'created_time': 1774675847.635316, 'last_price_update_time': 1774675847.635325, 'auction_closing_time': 1774716490.0}
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP38259') HTTP/1.1" 204 0
2026-03-28 05:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_9acce9f24cf1d67b6fd9e62c40e80b98.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_0ffa7c0e12448bd9cb838920d76b90ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fff%252F52ff53b3d081bc9857744b7c71ede268%252Fpa%252FGP45191_e9e192b8b5749284f262c74a14b9e0c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_e9e192b8b5749284f262c74a14b9e0c2.jpg not downloaded yet
2026-03-28 05:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_f435739b67759b136d42db286854b50d.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_af3cf8b1af67e581a54cfd23ec96ff78.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_df32d5c0958d31169ae57330a188c75c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_df32d5c0958d31169ae57330a188c75c.jpg not downloaded yet
2026-03-28 05:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439f9e2590>
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2746d8c-1505-511a-bb7b-066a4eff25be/e2746d8c-1505-511a-bb7b-066a4eff25be_image_0.jpg HTTP/1.1" 201 0
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fa9%252F7ca9925532e9a5ebd8b608db1d0f9499%252Fpa%252FGR29564_3c959f0b16491e81560e622848bebd94.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_3c959f0b16491e81560e622848bebd94.jpg saved to cache
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2746d8c-1505-511a-bb7b-066a4eff25be
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f43abc92f90>
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2746d8c-1505-511a-bb7b-066a4eff25be/e2746d8c-1505-511a-bb7b-066a4eff25be_image_1.jpg HTTP/1.1" 201 0
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fa9%252F7ca9925532e9a5ebd8b608db1d0f9499%252Fpa%252FGR29564_2f1e9d90ab08e7616f28116002dcb034.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_2f1e9d90ab08e7616f28116002dcb034.jpg saved to cache
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2746d8c-1505-511a-bb7b-066a4eff25be
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_cab5f3fa53123ee111e11bacd46a2e11.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_cab5f3fa53123ee111e11bacd46a2e11.jpg not downloaded yet
2026-03-28 05:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_751b1ccd2c5965f1bb05a2bf67ac9e44.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438fe13c90>
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c796b2cb-6102-53c1-be7b-c07fefb50e84/c796b2cb-6102-53c1-be7b-c07fefb50e84_image_0.jpg HTTP/1.1" 201 0
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fff%252F52ff53b3d081bc9857744b7c71ede268%252Fpa%252FGP45191_9acce9f24cf1d67b6fd9e62c40e80b98.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_9acce9f24cf1d67b6fd9e62c40e80b98.jpg saved to cache
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c796b2cb-6102-53c1-be7b-c07fefb50e84
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438fe15b90>
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2746d8c-1505-511a-bb7b-066a4eff25be/e2746d8c-1505-511a-bb7b-066a4eff25be_image_2.jpg HTTP/1.1" 201 0
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fa9%252F7ca9925532e9a5ebd8b608db1d0f9499%252Fpa%252FGR29564_0ffa7c0e12448bd9cb838920d76b90ab.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_0ffa7c0e12448bd9cb838920d76b90ab.jpg saved to cache
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2746d8c-1505-511a-bb7b-066a4eff25be
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_f5c5fc146294fbe7f590fb506d693a5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_f5c5fc146294fbe7f590fb506d693a5c.jpg not downloaded yet
2026-03-28 05:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_cff45db9a95172c6a04502edab78003d.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_f1efc3655ae1b11b15297f376b56fffc.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_18883a5ef40f6b510869f9f8bb4bc657.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_18883a5ef40f6b510869f9f8bb4bc657.jpg not downloaded yet
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438df1f050>
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2746d8c-1505-511a-bb7b-066a4eff25be/e2746d8c-1505-511a-bb7b-066a4eff25be_image_3.jpg HTTP/1.1" 201 0
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fa9%252F7ca9925532e9a5ebd8b608db1d0f9499%252Fpa%252FGR29564_f435739b67759b136d42db286854b50d.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_f435739b67759b136d42db286854b50d.jpg saved to cache
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2746d8c-1505-511a-bb7b-066a4eff25be
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438df01090>
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c796b2cb-6102-53c1-be7b-c07fefb50e84/c796b2cb-6102-53c1-be7b-c07fefb50e84_image_1.jpg HTTP/1.1" 201 0
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fff%252F52ff53b3d081bc9857744b7c71ede268%252Fpa%252FGP45191_af3cf8b1af67e581a54cfd23ec96ff78.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_af3cf8b1af67e581a54cfd23ec96ff78.jpg saved to cache
2026-03-28 05:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c796b2cb-6102-53c1-be7b-c07fefb50e84
2026-03-28 05:30:47 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 9199 | hits on page: 40
2026-03-28 05:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_e9e192b8b5749284f262c74a14b9e0c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_e6dd49d5abd8089d71515e0949420a6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_e6dd49d5abd8089d71515e0949420a6d.jpg not downloaded yet
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for SL53901: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for RY91957: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: WN78953
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: LK11873
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for XK18770: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: US80422
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US80422%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for US80422: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: PT81220
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT81220%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for PT81220: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for PD00543: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK88723%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for YK88723: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for AA46272: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for XS38036: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for SM91292: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for BY58400: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for VC01658: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for TF71705: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for WB36208: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for MF11383: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for WN56158: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: TB15479
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: TE23487
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE23487%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for TE23487: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for NG07529: 0
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-28 05:30:48 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [auto1.de] INFO: Scrape type for NP24686: 0
2026-03-28 05:30:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438df0e910>
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c796b2cb-6102-53c1-be7b-c07fefb50e84/c796b2cb-6102-53c1-be7b-c07fefb50e84_image_2.jpg HTTP/1.1" 201 0
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fff%252F52ff53b3d081bc9857744b7c71ede268%252Fpa%252FGP45191_751b1ccd2c5965f1bb05a2bf67ac9e44.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_751b1ccd2c5965f1bb05a2bf67ac9e44.jpg saved to cache
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c796b2cb-6102-53c1-be7b-c07fefb50e84
2026-03-28 05:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_71e645a0df1d02f112a1cfcc514d4762.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_931759609848087d1e3f66d36a5dae60.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_931759609848087d1e3f66d36a5dae60.jpg not downloaded yet
2026-03-28 05:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_cab5f3fa53123ee111e11bacd46a2e11.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_df32d5c0958d31169ae57330a188c75c.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438df3ee90>
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2746d8c-1505-511a-bb7b-066a4eff25be/e2746d8c-1505-511a-bb7b-066a4eff25be_image_4.jpg HTTP/1.1" 201 0
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fa9%252F7ca9925532e9a5ebd8b608db1d0f9499%252Fpa%252FGR29564_cff45db9a95172c6a04502edab78003d.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_cff45db9a95172c6a04502edab78003d.jpg saved to cache
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2746d8c-1505-511a-bb7b-066a4eff25be
2026-03-28 05:30:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2746d8c-1505-511a-bb7b-066a4eff25be, skipping ID generation
2026-03-28 05:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2746d8c-1505-511a-bb7b-066a4eff25be with scrape type 1
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2746d8c-1505-511a-bb7b-066a4eff25be sending to next pipeline
2026-03-28 05:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2746d8c-1505-511a-bb7b-066a4eff25be, identifier: GR29564
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438fe16790>
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c796b2cb-6102-53c1-be7b-c07fefb50e84/c796b2cb-6102-53c1-be7b-c07fefb50e84_image_3.jpg HTTP/1.1" 201 0
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fff%252F52ff53b3d081bc9857744b7c71ede268%252Fpa%252FGP45191_f1efc3655ae1b11b15297f376b56fffc.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_f1efc3655ae1b11b15297f376b56fffc.jpg saved to cache
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c796b2cb-6102-53c1-be7b-c07fefb50e84
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438ff90190>
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c796b2cb-6102-53c1-be7b-c07fefb50e84/c796b2cb-6102-53c1-be7b-c07fefb50e84_image_4.jpg HTTP/1.1" 201 0
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fff%252F52ff53b3d081bc9857744b7c71ede268%252Fpa%252FGP45191_e9e192b8b5749284f262c74a14b9e0c2.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_e9e192b8b5749284f262c74a14b9e0c2.jpg saved to cache
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c796b2cb-6102-53c1-be7b-c07fefb50e84
2026-03-28 05:30:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c796b2cb-6102-53c1-be7b-c07fefb50e84, skipping ID generation
2026-03-28 05:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c796b2cb-6102-53c1-be7b-c07fefb50e84 with scrape type 1
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c796b2cb-6102-53c1-be7b-c07fefb50e84 sending to next pipeline
2026-03-28 05:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c796b2cb-6102-53c1-be7b-c07fefb50e84, identifier: GP45191
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_c924a4c25905e6043ba547ed5d93cfe2.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_c924a4c25905e6043ba547ed5d93cfe2.jpg not downloaded yet
2026-03-28 05:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2746d8c-1505-511a-bb7b-066a4eff25be with identifier: GR29564
2026-03-28 05:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2746d8c-1505-511a-bb7b-066a4eff25be with identifier: GR29564
2026-03-28 05:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2746d8c-1505-511a-bb7b-066a4eff25be with identifier: GR29564 to the API
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_cff45db9a95172c6a04502edab78003d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '5.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:09:57Z',
 'fuel_type': 'petrol',
 'id': 'e2746d8c-1505-511a-bb7b-066a4eff25be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR29564',
 'listing': 'auction',
 'location': 'DE, Bremen',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 270644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2746d8c-1505-511a-bb7b-066a4eff25be/e2746d8c-1505-511a-bb7b-066a4eff25be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_3c959f0b16491e81560e622848bebd94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2746d8c-1505-511a-bb7b-066a4eff25be/e2746d8c-1505-511a-bb7b-066a4eff25be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_2f1e9d90ab08e7616f28116002dcb034.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2746d8c-1505-511a-bb7b-066a4eff25be/e2746d8c-1505-511a-bb7b-066a4eff25be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_0ffa7c0e12448bd9cb838920d76b90ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2746d8c-1505-511a-bb7b-066a4eff25be/e2746d8c-1505-511a-bb7b-066a4eff25be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_f435739b67759b136d42db286854b50d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2746d8c-1505-511a-bb7b-066a4eff25be/e2746d8c-1505-511a-bb7b-066a4eff25be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/a9/7ca9925532e9a5ebd8b608db1d0f9499/pa/GR29564_cff45db9a95172c6a04502edab78003d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1999-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR29564%27 HTTP/1.1" 200 None
2026-03-28 05:30:49 [auto1.de] INFO: Saving data for GR29564: {'created_time': 1774675849.323404, 'last_price_update_time': 1774675849.323417, 'auction_closing_time': 1774714197.0}
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR29564') HTTP/1.1" 204 0
2026-03-28 05:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c796b2cb-6102-53c1-be7b-c07fefb50e84 with identifier: GP45191
2026-03-28 05:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c796b2cb-6102-53c1-be7b-c07fefb50e84 with identifier: GP45191
2026-03-28 05:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c796b2cb-6102-53c1-be7b-c07fefb50e84 with identifier: GP45191 to the API
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_e9e192b8b5749284f262c74a14b9e0c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:00Z',
 'fuel_type': 'petrol',
 'id': 'c796b2cb-6102-53c1-be7b-c07fefb50e84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP45191',
 'listing': 'auction',
 'location': 'DE, Nürnberg',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 144128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c796b2cb-6102-53c1-be7b-c07fefb50e84/c796b2cb-6102-53c1-be7b-c07fefb50e84_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_9acce9f24cf1d67b6fd9e62c40e80b98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c796b2cb-6102-53c1-be7b-c07fefb50e84/c796b2cb-6102-53c1-be7b-c07fefb50e84_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_af3cf8b1af67e581a54cfd23ec96ff78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c796b2cb-6102-53c1-be7b-c07fefb50e84/c796b2cb-6102-53c1-be7b-c07fefb50e84_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_751b1ccd2c5965f1bb05a2bf67ac9e44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c796b2cb-6102-53c1-be7b-c07fefb50e84/c796b2cb-6102-53c1-be7b-c07fefb50e84_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_f1efc3655ae1b11b15297f376b56fffc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c796b2cb-6102-53c1-be7b-c07fefb50e84/c796b2cb-6102-53c1-be7b-c07fefb50e84_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/ff/52ff53b3d081bc9857744b7c71ede268/pa/GP45191_e9e192b8b5749284f262c74a14b9e0c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2011}
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45191%27 HTTP/1.1" 200 None
2026-03-28 05:30:49 [auto1.de] INFO: Saving data for GP45191: {'created_time': 1774675849.797897, 'last_price_update_time': 1774675849.797907, 'auction_closing_time': 1774716720.0}
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP45191') HTTP/1.1" 204 0
2026-03-28 05:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_18883a5ef40f6b510869f9f8bb4bc657.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438df343d0>
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_2.jpg HTTP/1.1" 201 0
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_71e645a0df1d02f112a1cfcc514d4762.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_71e645a0df1d02f112a1cfcc514d4762.jpg saved to cache
2026-03-28 05:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c135fd0>
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_4.jpg HTTP/1.1" 201 0
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_cab5f3fa53123ee111e11bacd46a2e11.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_cab5f3fa53123ee111e11bacd46a2e11.jpg saved to cache
2026-03-28 05:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c0cfed0>
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_3.jpg HTTP/1.1" 201 0
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_df32d5c0958d31169ae57330a188c75c.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_df32d5c0958d31169ae57330a188c75c.jpg saved to cache
2026-03-28 05:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c0cf610>
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_6.jpg HTTP/1.1" 201 0
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_18883a5ef40f6b510869f9f8bb4bc657.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_18883a5ef40f6b510869f9f8bb4bc657.jpg saved to cache
2026-03-28 05:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915
2026-03-28 05:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_e6dd49d5abd8089d71515e0949420a6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_3b452a578627a17fcae4e8b8b10d0f8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_6b7480a5b74e7dd8879a04ff192da4c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_426a2791226a3ece5eed077eb623b7e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_a3c3c4ffdb53fff23be9d533f1758bdd.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_f5c5fc146294fbe7f590fb506d693a5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_931759609848087d1e3f66d36a5dae60.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439e0537d0>
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_7.jpg HTTP/1.1" 201 0
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_e6dd49d5abd8089d71515e0949420a6d.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_e6dd49d5abd8089d71515e0949420a6d.jpg saved to cache
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915
2026-03-28 05:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_c924a4c25905e6043ba547ed5d93cfe2.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438fe158d0>
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_2.jpg HTTP/1.1" 201 0
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_3b452a578627a17fcae4e8b8b10d0f8a.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_3b452a578627a17fcae4e8b8b10d0f8a.jpg saved to cache
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9301628-71bd-55e5-9dce-82d4ff083f06
2026-03-28 05:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438ff5e010>
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_3.jpg HTTP/1.1" 201 0
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F91%252F6e91832874f78e63d2bf94c5243b4595%252Fpa%252FZJ20078_6b7480a5b74e7dd8879a04ff192da4c5.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_6b7480a5b74e7dd8879a04ff192da4c5.jpg saved to cache
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9301628-71bd-55e5-9dce-82d4ff083f06
2026-03-28 05:30:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9301628-71bd-55e5-9dce-82d4ff083f06, skipping ID generation
2026-03-28 05:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9301628-71bd-55e5-9dce-82d4ff083f06 with scrape type 1
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9301628-71bd-55e5-9dce-82d4ff083f06 sending to next pipeline
2026-03-28 05:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9301628-71bd-55e5-9dce-82d4ff083f06, identifier: ZJ20078
2026-03-28 05:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438df11050>
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_0.jpg HTTP/1.1" 201 0
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_426a2791226a3ece5eed077eb623b7e5.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_426a2791226a3ece5eed077eb623b7e5.jpg saved to cache
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915
2026-03-28 05:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c0cccd0>
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_1.jpg HTTP/1.1" 201 0
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_a3c3c4ffdb53fff23be9d533f1758bdd.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_a3c3c4ffdb53fff23be9d533f1758bdd.jpg saved to cache
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915
2026-03-28 05:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438df0e190>
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_5.jpg HTTP/1.1" 201 0
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_f5c5fc146294fbe7f590fb506d693a5c.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_f5c5fc146294fbe7f590fb506d693a5c.jpg saved to cache
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f439c1234d0>
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_8.jpg HTTP/1.1" 201 0
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_931759609848087d1e3f66d36a5dae60.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_931759609848087d1e3f66d36a5dae60.jpg saved to cache
2026-03-28 05:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915
2026-03-28 05:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9301628-71bd-55e5-9dce-82d4ff083f06 with identifier: ZJ20078
2026-03-28 05:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9301628-71bd-55e5-9dce-82d4ff083f06 with identifier: ZJ20078
2026-03-28 05:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9301628-71bd-55e5-9dce-82d4ff083f06 with identifier: ZJ20078 to the API
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_6b7480a5b74e7dd8879a04ff192da4c5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:55Z',
 'fuel_type': 'diesel',
 'id': 'd9301628-71bd-55e5-9dce-82d4ff083f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ20078',
 'listing': 'auction',
 'location': 'DE, Gera',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 89089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2507964,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_b985307472630905b2d5bfb8148313ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_ab7dd61ce7c040fa8bdf7e4829d91d66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2339823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_3b452a578627a17fcae4e8b8b10d0f8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2405062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_6b7480a5b74e7dd8879a04ff192da4c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_eec65f21d44cd8854dcea5e10bbab471.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_c33fceb17dd70cd8a34f7e713d7fe10c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2389046,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_da5f6511fdd211a5e55e7e2560df33a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380800,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_305fd49a07331757eaac44928c85b7d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2508604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_c8a3c9bea757002cbeec807e133741dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9301628-71bd-55e5-9dce-82d4ff083f06/d9301628-71bd-55e5-9dce-82d4ff083f06_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/91/6e91832874f78e63d2bf94c5243b4595/pa/ZJ20078_561fe003d0943fd3804ab58fce694787.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2016}
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-28 05:30:51 [auto1.de] INFO: Saving data for ZJ20078: {'created_time': 1774675851.398027, 'last_price_update_time': 1774675851.398037, 'auction_closing_time': 1774714015.0}
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ20078') HTTP/1.1" 204 0
2026-03-28 05:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f438fe1e550>
2026-03-28 05:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_9.jpg HTTP/1.1" 201 0
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F80%252Fb5809ac332f75e8f55f9e7953fd8386c%252Fpa%252FXB21556_c924a4c25905e6043ba547ed5d93cfe2.jpg') HTTP/1.1" 204 0
2026-03-28 05:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_c924a4c25905e6043ba547ed5d93cfe2.jpg saved to cache
2026-03-28 05:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915
2026-03-28 05:30:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915, skipping ID generation
2026-03-28 05:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915 with scrape type 1
2026-03-28 05:30:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915 sending to next pipeline
2026-03-28 05:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915, identifier: XB21556
2026-03-28 05:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915 with identifier: XB21556
2026-03-28 05:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915 with identifier: XB21556
2026-03-28 05:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f16c52a-62b4-5ef3-9562-1fb7f9fdb915 with identifier: XB21556 to the API
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_c924a4c25905e6043ba547ed5d93cfe2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:49:56Z',
 'fuel_type': 'diesel',
 'id': '0f16c52a-62b4-5ef3-9562-1fb7f9fdb915',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB21556',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 203971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2809979,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_426a2791226a3ece5eed077eb623b7e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_a3c3c4ffdb53fff23be9d533f1758bdd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_71e645a0df1d02f112a1cfcc514d4762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_df32d5c0958d31169ae57330a188c75c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_cab5f3fa53123ee111e11bacd46a2e11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2528220,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_f5c5fc146294fbe7f590fb506d693a5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_18883a5ef40f6b510869f9f8bb4bc657.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_e6dd49d5abd8089d71515e0949420a6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_931759609848087d1e3f66d36a5dae60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f16c52a-62b4-5ef3-9562-1fb7f9fdb915/0f16c52a-62b4-5ef3-9562-1fb7f9fdb915_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/80/b5809ac332f75e8f55f9e7953fd8386c/pa/XB21556_c924a4c25905e6043ba547ed5d93cfe2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2011}
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB21556%27 HTTP/1.1" 200 None
2026-03-28 05:30:51 [auto1.de] INFO: Saving data for XB21556: {'created_time': 1774675851.945062, 'last_price_update_time': 1774675851.945073, 'auction_closing_time': 1774716596.0}
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB21556') HTTP/1.1" 204 0
2026-03-28 05:30:51 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 9199 | hits on page: 40
2026-03-28 05:30:51 [auto1.de] INFO: Found listing with ID: PJ23427
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ23427%27 HTTP/1.1" 200 None
2026-03-28 05:30:51 [auto1.de] INFO: Scrape type for PJ23427: 2
2026-03-28 05:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e632d6e3-70c6-5f15-b911-618d8664f1bf with identifier: PJ23427
2026-03-28 05:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e632d6e3-70c6-5f15-b911-618d8664f1bf with scrape type 2
2026-03-28 05:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e632d6e3-70c6-5f15-b911-618d8664f1bf with scrape type 2
2026-03-28 05:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e632d6e3-70c6-5f15-b911-618d8664f1bf, identifier: PJ23427
2026-03-28 05:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e632d6e3-70c6-5f15-b911-618d8664f1bf with identifier: PJ23427
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 05:30:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e632d6e3-70c6-5f15-b911-618d8664f1bf with identifier: PJ23427
2026-03-28 05:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e632d6e3-70c6-5f15-b911-618d8664f1bf with identifier: PJ23427 to the API
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:57:57Z',
 'fuel_type': 'diesel',
 'id': 'e632d6e3-70c6-5f15-b911-618d8664f1bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ23427',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 368105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-27',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 116 CDI lang Pro',
 'transmission': 'automatic',
 'trim': 'lang Pro',
 'year': 2018}
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ23427%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Saving data for PJ23427: {'auction_closing_time': 1774717077.0, 'created_time': 1774551952.498543, 'last_price_update_time': 1774675852.558496}
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ23427') HTTP/1.1" 204 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for NF91917: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for YS84502: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: TC10738
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for YJ27680: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for TE32041: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for GJ71722: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for ZF02079: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for PW56805: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for AG47249: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK29715%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for CK29715: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for HX15626: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for DN49518: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for XY67074: 0
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-28 05:30:52 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-28 05:30:52 [auto1.de] INFO: Scrape type for KR66468: 2
2026-03-28 05:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8145828b-9c8a-59f3-8a33-b13ce1332643 with identifier: KR66468
2026-03-28 05:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8145828b-9c8a-59f3-8a33-b13ce1332643 with scrape type 2
2026-03-28 05:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8145828b-9c8a-59f3-8a33-b13ce1332643 with scrape type 2
2026-03-28 05:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8145828b-9c8a-59f3-8a33-b13ce1332643, identifier: KR66468
2026-03-28 05:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8145828b-9c8a-59f3-8a33-b13ce1332643 with identifier: KR66468
2026-03-28 05:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8145828b-9c8a-59f3-8a33-b13ce1332643 with identifier: KR66468
2026-03-28 05:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8145828b-9c8a-59f3-8a33-b13ce1332643 with identifier: KR66468 to the API
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:26:45Z',
 'fuel_type': 'diesel',
 'id': '8145828b-9c8a-59f3-8a33-b13ce1332643',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR66468',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 234612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-24',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion BlueMotion',
 'year': 2017}
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-28 05:30:53 [auto1.de] INFO: Saving data for KR66468: {'auction_closing_time': 1774715205.0, 'created_time': 1774551514.125757, 'last_price_update_time': 1774675853.27525}
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR66468') HTTP/1.1" 204 0
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-28 05:30:53 [auto1.de] INFO: Scrape type for ZF64276: 0
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-28 05:30:53 [auto1.de] INFO: Scrape type for ZE67546: 0
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: VV75383
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-28 05:30:53 [auto1.de] INFO: Scrape type for XT71149: 0
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: RB39093
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: FX57031
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: MF29481
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF29481%27 HTTP/1.1" 200 None
2026-03-28 05:30:53 [auto1.de] INFO: Scrape type for MF29481: 0
2026-03-28 05:30:53 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-28 05:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:54 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 9199 | hits on page: 40
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for TL72332: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for GH93549: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for MR61415: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: GE07622
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE07622%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for GE07622: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: YB13434
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: DN72961
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for WY73016: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for RC37998: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for LU56386: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46079%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for VV46079: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: AB20934
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB20934%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for AB20934: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for SJ47682: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: FX68518
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX68518%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for FX68518: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for BV47016: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: JF90132
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF90132%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for JF90132: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for PH00076: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: CU59576
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for CU11315: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for KN67174: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for LM10122: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for PT52067: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: LJ89575
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ89575%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for LJ89575: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-28 05:30:54 [auto1.de] INFO: Scrape type for JD98482: 0
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-28 05:30:54 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-28 05:30:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:30:55 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 9199 | hits on page: 40
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-28 05:30:55 [auto1.de] INFO: Scrape type for UT25770: 0
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-28 05:30:55 [auto1.de] INFO: Scrape type for GT00768: 0
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP66494%27 HTTP/1.1" 200 None
2026-03-28 05:30:55 [auto1.de] INFO: Scrape type for UP66494: 0
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-28 05:30:55 [auto1.de] INFO: Scrape type for FD81187: 0
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF53882%27 HTTP/1.1" 200 None
2026-03-28 05:30:55 [auto1.de] INFO: Scrape type for HF53882: 0
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: MX06399
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: XX93407
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-28 05:30:55 [auto1.de] INFO: Scrape type for EG14085: 0
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: SE90134
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE90134%27 HTTP/1.1" 200 None
2026-03-28 05:30:55 [auto1.de] INFO: Scrape type for SE90134: 0
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: GN38725
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-28 05:30:55 [auto1.de] INFO: Scrape type for GK43362: 0
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: LZ73425
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ73425%27 HTTP/1.1" 200 None
2026-03-28 05:30:55 [auto1.de] INFO: Scrape type for LZ73425: 0
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: PV39921
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: UM40776
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: PR48691
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR48691%27 HTTP/1.1" 200 None
2026-03-28 05:30:55 [auto1.de] INFO: Scrape type for PR48691: 0
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR11811%27 HTTP/1.1" 200 None
2026-03-28 05:30:55 [auto1.de] INFO: Scrape type for BR11811: 0
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: BX52311
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: HF45615
2026-03-28 05:30:55 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-28 05:30:56 [auto1.de] INFO: Scrape type for MU06358: 0
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: TE36715
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE36715%27 HTTP/1.1" 200 None
2026-03-28 05:30:56 [auto1.de] INFO: Scrape type for TE36715: 0
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: KN06513
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN06513%27 HTTP/1.1" 200 None
2026-03-28 05:30:56 [auto1.de] INFO: Scrape type for KN06513: 0
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: EX28790
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: GE34935
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35615%27 HTTP/1.1" 200 None
2026-03-28 05:30:56 [auto1.de] INFO: Scrape type for HZ35615: 0
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: LK84028
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK84028%27 HTTP/1.1" 200 None
2026-03-28 05:30:56 [auto1.de] INFO: Scrape type for LK84028: 0
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-28 05:30:56 [auto1.de] INFO: Scrape type for CD36674: 0
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: FV70322
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV70322%27 HTTP/1.1" 200 None
2026-03-28 05:30:56 [auto1.de] INFO: Scrape type for FV70322: 0
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-28 05:30:56 [auto1.de] INFO: Scrape type for YH66607: 0
2026-03-28 05:30:56 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-28 05:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:06 [scrapy.extensions.logstats] INFO: Crawled 40 pages (at 40 pages/min), scraped 41 items (at 41 items/min)
2026-03-28 05:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:07 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for WM97258: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for NY21344: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY45695%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for YY45695: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: RG19382
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG19382%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for RG19382: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: JB27524
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB27524%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for JB27524: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: DV44550
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV44550%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for DV44550: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for MZ72093: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: RT03172
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT03172%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for RT03172: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: MN73743
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN73743%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for MN73743: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: XG23027
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG23027%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for XG23027: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: UV23463
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: KX75586
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX75586%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for KX75586: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: JD23265
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for WP12836: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: AZ36706
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ36706%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for AZ36706: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for ZK33939: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for XR25495: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: CC17090
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC17090%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for CC17090: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for DW36097: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: EB80315
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: TK28110
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK28110%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for TK28110: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: TB76582
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB76582%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for TB76582: 0
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: FW04904
2026-03-28 05:31:07 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-28 05:31:07 [auto1.de] INFO: Scrape type for XM92815: 2
2026-03-28 05:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9a3b41c-7c0b-53b2-a18b-731af48fd845 with identifier: XM92815
2026-03-28 05:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a3b41c-7c0b-53b2-a18b-731af48fd845 with scrape type 2
2026-03-28 05:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9a3b41c-7c0b-53b2-a18b-731af48fd845 with scrape type 2
2026-03-28 05:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9a3b41c-7c0b-53b2-a18b-731af48fd845, identifier: XM92815
2026-03-28 05:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9a3b41c-7c0b-53b2-a18b-731af48fd845 with identifier: XM92815
2026-03-28 05:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9a3b41c-7c0b-53b2-a18b-731af48fd845 with identifier: XM92815
2026-03-28 05:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9a3b41c-7c0b-53b2-a18b-731af48fd845 with identifier: XM92815 to the API
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:37:33Z',
 'fuel_type': 'petrol',
 'id': 'b9a3b41c-7c0b-53b2-a18b-731af48fd845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM92815',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 200923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-10',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2007}
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-28 05:31:08 [auto1.de] INFO: Saving data for XM92815: {'auction_closing_time': 1774715853.0, 'created_time': 1774550722.990921, 'last_price_update_time': 1774675868.061775}
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM92815') HTTP/1.1" 204 0
2026-03-28 05:31:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:08 [auto1.de] INFO: Found listing with ID: GK45349
2026-03-28 05:31:08 [auto1.de] INFO: Found listing with ID: YR17987
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR17987%27 HTTP/1.1" 200 None
2026-03-28 05:31:08 [auto1.de] INFO: Scrape type for YR17987: 0
2026-03-28 05:31:08 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-28 05:31:08 [auto1.de] INFO: Scrape type for FY87536: 2
2026-03-28 05:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536
2026-03-28 05:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e35780-76f8-5445-adec-7dae87def37a with scrape type 2
2026-03-28 05:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33e35780-76f8-5445-adec-7dae87def37a with scrape type 2
2026-03-28 05:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33e35780-76f8-5445-adec-7dae87def37a, identifier: FY87536
2026-03-28 05:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536
2026-03-28 05:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536
2026-03-28 05:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536 to the API
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:49:03Z',
 'fuel_type': 'diesel',
 'id': '33e35780-76f8-5445-adec-7dae87def37a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY87536',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 145756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-19',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-28 05:31:08 [auto1.de] INFO: Saving data for FY87536: {'auction_closing_time': 1774716543.0, 'created_time': 1774551177.68908, 'last_price_update_time': 1774675868.69739}
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY87536') HTTP/1.1" 204 0
2026-03-28 05:31:08 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-28 05:31:08 [auto1.de] INFO: Scrape type for WG96363: 0
2026-03-28 05:31:08 [auto1.de] INFO: Found listing with ID: ZP12024
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP12024%27 HTTP/1.1" 200 None
2026-03-28 05:31:08 [auto1.de] INFO: Scrape type for ZP12024: 0
2026-03-28 05:31:08 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-28 05:31:08 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-28 05:31:08 [auto1.de] INFO: Found listing with ID: HG90812
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG90812%27 HTTP/1.1" 200 None
2026-03-28 05:31:08 [auto1.de] INFO: Scrape type for HG90812: 0
2026-03-28 05:31:08 [auto1.de] INFO: Found listing with ID: ZT59384
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT59384%27 HTTP/1.1" 200 None
2026-03-28 05:31:08 [auto1.de] INFO: Scrape type for ZT59384: 0
2026-03-28 05:31:08 [auto1.de] INFO: Found listing with ID: KK74048
2026-03-28 05:31:08 [auto1.de] INFO: Found listing with ID: PY20785
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY20785%27 HTTP/1.1" 200 None
2026-03-28 05:31:08 [auto1.de] INFO: Scrape type for PY20785: 0
2026-03-28 05:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:09 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:09 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-28 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-28 05:31:09 [auto1.de] INFO: Scrape type for KC39120: 2
2026-03-28 05:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120
2026-03-28 05:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with scrape type 2
2026-03-28 05:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with scrape type 2
2026-03-28 05:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a, identifier: KC39120
2026-03-28 05:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120
2026-03-28 05:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120
2026-03-28 05:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120 to the API
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:59:06Z',
 'fuel_type': 'petrol',
 'id': '0f1e3fdb-040b-5ad2-8326-bad3e4662b1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC39120',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 84743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-12',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2019}
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-28 05:31:10 [auto1.de] INFO: Saving data for KC39120: {'auction_closing_time': 1774717146.0, 'created_time': 1774551862.836859, 'last_price_update_time': 1774675870.311201}
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC39120') HTTP/1.1" 204 0
2026-03-28 05:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: NF92899
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF92899%27 HTTP/1.1" 200 None
2026-03-28 05:31:10 [auto1.de] INFO: Scrape type for NF92899: 2
2026-03-28 05:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da7455a3-7942-55eb-aca1-20201ccf1c98 with identifier: NF92899
2026-03-28 05:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da7455a3-7942-55eb-aca1-20201ccf1c98 with scrape type 2
2026-03-28 05:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da7455a3-7942-55eb-aca1-20201ccf1c98 with scrape type 2
2026-03-28 05:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da7455a3-7942-55eb-aca1-20201ccf1c98, identifier: NF92899
2026-03-28 05:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da7455a3-7942-55eb-aca1-20201ccf1c98 with identifier: NF92899
2026-03-28 05:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da7455a3-7942-55eb-aca1-20201ccf1c98 with identifier: NF92899
2026-03-28 05:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da7455a3-7942-55eb-aca1-20201ccf1c98 with identifier: NF92899 to the API
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:17:49Z',
 'fuel_type': 'petrol',
 'id': 'da7455a3-7942-55eb-aca1-20201ccf1c98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF92899',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 116530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-11-04',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.3 4 Seasons',
 'transmission': 'manual',
 'trim': '4 Seasons',
 'year': 2003}
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF92899%27 HTTP/1.1" 200 None
2026-03-28 05:31:10 [auto1.de] INFO: Saving data for NF92899: {'auction_closing_time': 1774714669.0, 'created_time': 1774550473.181723, 'last_price_update_time': 1774675870.844699}
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF92899') HTTP/1.1" 204 0
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: TA25179
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: VK99504
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: HK08818
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: YR03483
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR03483%27 HTTP/1.1" 200 None
2026-03-28 05:31:10 [auto1.de] INFO: Scrape type for YR03483: 0
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: XK43305
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: VK29322
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK29322%27 HTTP/1.1" 200 None
2026-03-28 05:31:10 [auto1.de] INFO: Scrape type for VK29322: 0
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: JZ88566
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: SX40861
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: JE79416
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79416%27 HTTP/1.1" 200 None
2026-03-28 05:31:10 [auto1.de] INFO: Scrape type for JE79416: 0
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: MJ40039
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ40039%27 HTTP/1.1" 200 None
2026-03-28 05:31:10 [auto1.de] INFO: Scrape type for MJ40039: 0
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: PH95596
2026-03-28 05:31:10 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-28 05:31:10 [auto1.de] INFO: Scrape type for WC38783: 2
2026-03-28 05:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with identifier: WC38783
2026-03-28 05:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with scrape type 2
2026-03-28 05:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with scrape type 2
2026-03-28 05:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968, identifier: WC38783
2026-03-28 05:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with identifier: WC38783
2026-03-28 05:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with identifier: WC38783
2026-03-28 05:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with identifier: WC38783 to the API
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:05:17Z',
 'fuel_type': 'diesel',
 'id': 'f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC38783',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 422135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-31',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2016}
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-28 05:31:11 [auto1.de] INFO: Saving data for WC38783: {'auction_closing_time': 1774713917.0, 'created_time': 1773945977.857225, 'last_price_update_time': 1774675871.396113}
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC38783') HTTP/1.1" 204 0
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: LH77373
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: UG43365
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: HP12660
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-28 05:31:11 [auto1.de] INFO: Scrape type for HE35464: 2
2026-03-28 05:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 006eb929-2593-5e7c-9ab4-ea49ecf09784 with identifier: HE35464
2026-03-28 05:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 006eb929-2593-5e7c-9ab4-ea49ecf09784 with scrape type 2
2026-03-28 05:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 006eb929-2593-5e7c-9ab4-ea49ecf09784 with scrape type 2
2026-03-28 05:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 006eb929-2593-5e7c-9ab4-ea49ecf09784, identifier: HE35464
2026-03-28 05:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 006eb929-2593-5e7c-9ab4-ea49ecf09784 with identifier: HE35464
2026-03-28 05:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 006eb929-2593-5e7c-9ab4-ea49ecf09784 with identifier: HE35464
2026-03-28 05:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 006eb929-2593-5e7c-9ab4-ea49ecf09784 with identifier: HE35464 to the API
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:47:56Z',
 'fuel_type': 'diesel',
 'id': '006eb929-2593-5e7c-9ab4-ea49ecf09784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE35464',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '4007',
 'odometer': 260272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'Peugeot 4007 2.2 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-28 05:31:11 [auto1.de] INFO: Saving data for HE35464: {'auction_closing_time': 1774716476.0, 'created_time': 1774552695.447688, 'last_price_update_time': 1774675871.92497}
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE35464') HTTP/1.1" 204 0
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: UD40582
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: PU06584
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: XA03133
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA03133%27 HTTP/1.1" 200 None
2026-03-28 05:31:11 [auto1.de] INFO: Scrape type for XA03133: 0
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: UP05296
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: FJ62780
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ62780%27 HTTP/1.1" 200 None
2026-03-28 05:31:11 [auto1.de] INFO: Scrape type for FJ62780: 0
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: JE58161
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-28 05:31:11 [auto1.de] INFO: Scrape type for JH64089: 0
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-28 05:31:11 [auto1.de] INFO: Found listing with ID: RW16668
2026-03-28 05:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW16668%27 HTTP/1.1" 200 None
2026-03-28 05:31:12 [auto1.de] INFO: Scrape type for RW16668: 0
2026-03-28 05:31:12 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-28 05:31:12 [auto1.de] INFO: Found listing with ID: NZ53793
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ53793%27 HTTP/1.1" 200 None
2026-03-28 05:31:12 [auto1.de] INFO: Scrape type for NZ53793: 0
2026-03-28 05:31:12 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-28 05:31:12 [auto1.de] INFO: Scrape type for LC05735: 2
2026-03-28 05:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735
2026-03-28 05:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with scrape type 2
2026-03-28 05:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with scrape type 2
2026-03-28 05:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 515d0088-dc9f-5bc2-be38-cdc35e754cd5, identifier: LC05735
2026-03-28 05:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735
2026-03-28 05:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735
2026-03-28 05:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735 to the API
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:45:51Z',
 'fuel_type': 'petrol',
 'id': '515d0088-dc9f-5bc2-be38-cdc35e754cd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC05735',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 19216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-17',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake Mild-Hybrid AMG '
          'Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-28 05:31:12 [auto1.de] INFO: Saving data for LC05735: {'auction_closing_time': 1774716351.0, 'created_time': 1773307137.637304, 'last_price_update_time': 1774675872.483726}
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC05735') HTTP/1.1" 204 0
2026-03-28 05:31:12 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-28 05:31:12 [auto1.de] INFO: Scrape type for SC92751: 2
2026-03-28 05:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b48adb90-380e-592a-9fe3-d199d59260b0 with identifier: SC92751
2026-03-28 05:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b48adb90-380e-592a-9fe3-d199d59260b0 with scrape type 2
2026-03-28 05:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b48adb90-380e-592a-9fe3-d199d59260b0 with scrape type 2
2026-03-28 05:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b48adb90-380e-592a-9fe3-d199d59260b0, identifier: SC92751
2026-03-28 05:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b48adb90-380e-592a-9fe3-d199d59260b0 with identifier: SC92751
2026-03-28 05:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b48adb90-380e-592a-9fe3-d199d59260b0 with identifier: SC92751
2026-03-28 05:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b48adb90-380e-592a-9fe3-d199d59260b0 with identifier: SC92751 to the API
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:38Z',
 'fuel_type': 'diesel',
 'id': 'b48adb90-380e-592a-9fe3-d199d59260b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC92751',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 270152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2018}
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-28 05:31:13 [auto1.de] INFO: Saving data for SC92751: {'auction_closing_time': 1774713938.0, 'created_time': 1774552441.047834, 'last_price_update_time': 1774675873.021478}
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC92751') HTTP/1.1" 204 0
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: GV92310
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV92310%27 HTTP/1.1" 200 None
2026-03-28 05:31:13 [auto1.de] INFO: Scrape type for GV92310: 0
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: UC51546
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC51546%27 HTTP/1.1" 200 None
2026-03-28 05:31:13 [auto1.de] INFO: Scrape type for UC51546: 0
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: NV63188
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV63188%27 HTTP/1.1" 200 None
2026-03-28 05:31:13 [auto1.de] INFO: Scrape type for NV63188: 0
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: UG57897
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: ZC12806
2026-03-28 05:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:13 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: SM33942
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: BW22563
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW22563%27 HTTP/1.1" 200 None
2026-03-28 05:31:13 [auto1.de] INFO: Scrape type for BW22563: 2
2026-03-28 05:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a6e9fe-a4fb-56d3-b4de-10b436fd5161 with identifier: BW22563
2026-03-28 05:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a6e9fe-a4fb-56d3-b4de-10b436fd5161 with scrape type 2
2026-03-28 05:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21a6e9fe-a4fb-56d3-b4de-10b436fd5161 with scrape type 2
2026-03-28 05:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21a6e9fe-a4fb-56d3-b4de-10b436fd5161, identifier: BW22563
2026-03-28 05:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21a6e9fe-a4fb-56d3-b4de-10b436fd5161 with identifier: BW22563
2026-03-28 05:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21a6e9fe-a4fb-56d3-b4de-10b436fd5161 with identifier: BW22563
2026-03-28 05:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21a6e9fe-a4fb-56d3-b4de-10b436fd5161 with identifier: BW22563 to the API
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:11Z',
 'fuel_type': 'petrol',
 'id': '21a6e9fe-a4fb-56d3-b4de-10b436fd5161',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW22563',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 57531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-05',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW22563%27 HTTP/1.1" 200 None
2026-03-28 05:31:13 [auto1.de] INFO: Saving data for BW22563: {'auction_closing_time': 1774716431.0, 'created_time': 1774463650.904249, 'last_price_update_time': 1774675873.895685}
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW22563') HTTP/1.1" 204 0
2026-03-28 05:31:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-28 05:31:13 [auto1.de] INFO: Scrape type for ZH21180: 0
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: CH92359
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH92359%27 HTTP/1.1" 200 None
2026-03-28 05:31:13 [auto1.de] INFO: Scrape type for CH92359: 0
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: VP44882
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP44882%27 HTTP/1.1" 200 None
2026-03-28 05:31:13 [auto1.de] INFO: Scrape type for VP44882: 0
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: PU27308
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU27308%27 HTTP/1.1" 200 None
2026-03-28 05:31:13 [auto1.de] INFO: Scrape type for PU27308: 0
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: MF99655
2026-03-28 05:31:13 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-28 05:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for DT00101: 0
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: KF20598
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: JE92990
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE92990%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for JE92990: 0
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: CT69735
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: WV63025
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV63025%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for WV63025: 0
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: NR70794
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: NZ80756
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: CW24668
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW24668%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for CW24668: 2
2026-03-28 05:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d31eb78-c238-58a8-933a-fc493ce275d0 with identifier: CW24668
2026-03-28 05:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d31eb78-c238-58a8-933a-fc493ce275d0 with scrape type 2
2026-03-28 05:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d31eb78-c238-58a8-933a-fc493ce275d0 with scrape type 2
2026-03-28 05:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d31eb78-c238-58a8-933a-fc493ce275d0, identifier: CW24668
2026-03-28 05:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d31eb78-c238-58a8-933a-fc493ce275d0 with identifier: CW24668
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 05:31:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d31eb78-c238-58a8-933a-fc493ce275d0 with identifier: CW24668
2026-03-28 05:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d31eb78-c238-58a8-933a-fc493ce275d0 with identifier: CW24668 to the API
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:00:40Z',
 'fuel_type': 'diesel',
 'id': '7d31eb78-c238-58a8-933a-fc493ce275d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW24668',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 105310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueTEC Edition',
 'year': 2018}
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW24668%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Saving data for CW24668: {'auction_closing_time': 1774713640.0, 'created_time': 1774552181.833002, 'last_price_update_time': 1774675874.60756}
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW24668') HTTP/1.1" 204 0
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: DL13353
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL13353%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for DL13353: 0
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: MA94395
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA94395%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for MA94395: 0
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: GZ91789
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ91789%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for GZ91789: 0
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: XE14279
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE14279%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for XE14279: 0
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: SG32034
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: KZ13921
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: FC39269
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: GF71655
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF71655%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for GF71655: 0
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for FY99153: 0
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: FW21931
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: WZ12668
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ12668%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for WZ12668: 0
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: ZR53559
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: TX72935
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: UM61936
2026-03-28 05:31:14 [auto1.de] INFO: Found listing with ID: AM47417
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM47417%27 HTTP/1.1" 200 None
2026-03-28 05:31:14 [auto1.de] INFO: Scrape type for AM47417: 2
2026-03-28 05:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae0308ae-9b2d-5e04-b565-1b4a14820fa2 with identifier: AM47417
2026-03-28 05:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae0308ae-9b2d-5e04-b565-1b4a14820fa2 with scrape type 2
2026-03-28 05:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae0308ae-9b2d-5e04-b565-1b4a14820fa2 with scrape type 2
2026-03-28 05:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae0308ae-9b2d-5e04-b565-1b4a14820fa2, identifier: AM47417
2026-03-28 05:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae0308ae-9b2d-5e04-b565-1b4a14820fa2 with identifier: AM47417
2026-03-28 05:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae0308ae-9b2d-5e04-b565-1b4a14820fa2 with identifier: AM47417
2026-03-28 05:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae0308ae-9b2d-5e04-b565-1b4a14820fa2 with identifier: AM47417 to the API
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:10:29Z',
 'fuel_type': 'petrol',
 'id': 'ae0308ae-9b2d-5e04-b565-1b4a14820fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM47417',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 153782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-30',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 More',
 'transmission': 'manual',
 'trim': 'More',
 'year': 2012}
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM47417%27 HTTP/1.1" 200 None
2026-03-28 05:31:15 [auto1.de] INFO: Saving data for AM47417: {'auction_closing_time': 1774714229.0, 'created_time': 1774552742.514502, 'last_price_update_time': 1774675875.287455}
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM47417') HTTP/1.1" 204 0
2026-03-28 05:31:15 [auto1.de] INFO: Found listing with ID: UG86555
2026-03-28 05:31:15 [auto1.de] INFO: Found listing with ID: XV41644
2026-03-28 05:31:15 [auto1.de] INFO: Found listing with ID: NA57032
2026-03-28 05:31:15 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-28 05:31:15 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-28 05:31:15 [auto1.de] INFO: Scrape type for DF28851: 0
2026-03-28 05:31:15 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51376%27 HTTP/1.1" 200 None
2026-03-28 05:31:15 [auto1.de] INFO: Scrape type for ER51376: 0
2026-03-28 05:31:15 [auto1.de] INFO: Found listing with ID: SK50267
2026-03-28 05:31:15 [auto1.de] INFO: Found listing with ID: BS50452
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS50452%27 HTTP/1.1" 200 None
2026-03-28 05:31:15 [auto1.de] INFO: Scrape type for BS50452: 0
2026-03-28 05:31:15 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-28 05:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:16 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-28 05:31:16 [auto1.de] INFO: Scrape type for JH84206: 0
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: UD72248
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD72248%27 HTTP/1.1" 200 None
2026-03-28 05:31:16 [auto1.de] INFO: Scrape type for UD72248: 0
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: TE29693
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: CE63611
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE63611%27 HTTP/1.1" 200 None
2026-03-28 05:31:16 [auto1.de] INFO: Scrape type for CE63611: 0
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-28 05:31:16 [auto1.de] INFO: Scrape type for GJ77265: 0
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: NE03141
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: CH49236
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: SV49639
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-28 05:31:16 [auto1.de] INFO: Scrape type for AU22690: 2
2026-03-28 05:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with identifier: AU22690
2026-03-28 05:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with scrape type 2
2026-03-28 05:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with scrape type 2
2026-03-28 05:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c, identifier: AU22690
2026-03-28 05:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with identifier: AU22690
2026-03-28 05:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with identifier: AU22690
2026-03-28 05:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with identifier: AU22690 to the API
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-28T16:39:58Z',
 'fuel_type': 'petrol',
 'id': 'a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU22690',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 16215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-19',
 'seller_name': None,
 'title': 'Kia Stonic 1.2 Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2023}
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-28 05:31:16 [auto1.de] INFO: Saving data for AU22690: {'auction_closing_time': 1774715998.0, 'created_time': 1774551864.532826, 'last_price_update_time': 1774675876.794035}
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU22690') HTTP/1.1" 204 0
2026-03-28 05:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: XS52546
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: EN21542
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: BB62931
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB62931%27 HTTP/1.1" 200 None
2026-03-28 05:31:16 [auto1.de] INFO: Scrape type for BB62931: 0
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: MA30458
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-28 05:31:16 [auto1.de] INFO: Scrape type for HE21190: 0
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: XF22574
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-28 05:31:16 [auto1.de] INFO: Scrape type for GW76676: 0
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: CP53358
2026-03-28 05:31:16 [auto1.de] INFO: Found listing with ID: CA88273
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA88273%27 HTTP/1.1" 200 None
2026-03-28 05:31:16 [auto1.de] INFO: Scrape type for CA88273: 2
2026-03-28 05:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a089ae31-1e6d-5df0-8ad1-2d6b04e08eba with identifier: CA88273
2026-03-28 05:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a089ae31-1e6d-5df0-8ad1-2d6b04e08eba with scrape type 2
2026-03-28 05:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a089ae31-1e6d-5df0-8ad1-2d6b04e08eba with scrape type 2
2026-03-28 05:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a089ae31-1e6d-5df0-8ad1-2d6b04e08eba, identifier: CA88273
2026-03-28 05:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a089ae31-1e6d-5df0-8ad1-2d6b04e08eba with identifier: CA88273
2026-03-28 05:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a089ae31-1e6d-5df0-8ad1-2d6b04e08eba with identifier: CA88273
2026-03-28 05:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a089ae31-1e6d-5df0-8ad1-2d6b04e08eba with identifier: CA88273 to the API
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:30:41Z',
 'fuel_type': 'diesel',
 'id': 'a089ae31-1e6d-5df0-8ad1-2d6b04e08eba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA88273',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 154958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-03',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA88273%27 HTTP/1.1" 200 None
2026-03-28 05:31:17 [auto1.de] INFO: Saving data for CA88273: {'auction_closing_time': 1774715441.0, 'created_time': 1774552712.391316, 'last_price_update_time': 1774675877.37021}
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA88273') HTTP/1.1" 204 0
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: YJ97695
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: ZN04529
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04529%27 HTTP/1.1" 200 None
2026-03-28 05:31:17 [auto1.de] INFO: Scrape type for ZN04529: 0
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: KF35020
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: JM94296
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM94296%27 HTTP/1.1" 200 None
2026-03-28 05:31:17 [auto1.de] INFO: Scrape type for JM94296: 0
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: NH88126
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH88126%27 HTTP/1.1" 200 None
2026-03-28 05:31:17 [auto1.de] INFO: Scrape type for NH88126: 0
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: EU09282
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-28 05:31:17 [auto1.de] INFO: Scrape type for RN98053: 0
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: PX72797
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: KX24759
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24759%27 HTTP/1.1" 200 None
2026-03-28 05:31:17 [auto1.de] INFO: Scrape type for KX24759: 0
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: PB81090
2026-03-28 05:31:17 [auto1.de] INFO: Found listing with ID: LD36602
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD36602%27 HTTP/1.1" 200 None
2026-03-28 05:31:17 [auto1.de] INFO: Scrape type for LD36602: 0
2026-03-28 05:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:18 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:18 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-28 05:31:18 [auto1.de] INFO: Scrape type for SF55933: 0
2026-03-28 05:31:18 [auto1.de] INFO: Found listing with ID: BE30085
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE30085%27 HTTP/1.1" 200 None
2026-03-28 05:31:18 [auto1.de] INFO: Scrape type for BE30085: 2
2026-03-28 05:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a82e0269-2b50-5298-8cfb-262a6a246dab with identifier: BE30085
2026-03-28 05:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a82e0269-2b50-5298-8cfb-262a6a246dab with scrape type 2
2026-03-28 05:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a82e0269-2b50-5298-8cfb-262a6a246dab with scrape type 2
2026-03-28 05:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a82e0269-2b50-5298-8cfb-262a6a246dab, identifier: BE30085
2026-03-28 05:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a82e0269-2b50-5298-8cfb-262a6a246dab with identifier: BE30085
2026-03-28 05:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a82e0269-2b50-5298-8cfb-262a6a246dab with identifier: BE30085
2026-03-28 05:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a82e0269-2b50-5298-8cfb-262a6a246dab with identifier: BE30085 to the API
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:50:53Z',
 'fuel_type': 'diesel',
 'id': 'a82e0269-2b50-5298-8cfb-262a6a246dab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE30085',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 79231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.5 Blue dCi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2019}
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE30085%27 HTTP/1.1" 200 None
2026-03-28 05:31:18 [auto1.de] INFO: Saving data for BE30085: {'auction_closing_time': 1774716653.0, 'created_time': 1774264777.250002, 'last_price_update_time': 1774675878.774877}
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE30085') HTTP/1.1" 204 0
2026-03-28 05:31:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:18 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-28 05:31:18 [auto1.de] INFO: Found listing with ID: FH28762
2026-03-28 05:31:18 [auto1.de] INFO: Found listing with ID: LC01994
2026-03-28 05:31:18 [auto1.de] INFO: Found listing with ID: GF50389
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF50389%27 HTTP/1.1" 200 None
2026-03-28 05:31:18 [auto1.de] INFO: Scrape type for GF50389: 0
2026-03-28 05:31:18 [auto1.de] INFO: Found listing with ID: PB92284
2026-03-28 05:31:18 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-28 05:31:18 [auto1.de] INFO: Scrape type for KX26949: 2
2026-03-28 05:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with identifier: KX26949
2026-03-28 05:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with scrape type 2
2026-03-28 05:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with scrape type 2
2026-03-28 05:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d, identifier: KX26949
2026-03-28 05:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with identifier: KX26949
2026-03-28 05:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with identifier: KX26949
2026-03-28 05:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with identifier: KX26949 to the API
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:47:05Z',
 'fuel_type': 'diesel',
 'id': '06bc3f6d-0e77-55b0-9739-99b67b2b4e0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX26949',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 168793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-10',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 280 M Trend LKW',
 'transmission': 'manual',
 'trim': 'FT 280 M Trend LKW',
 'year': 2011}
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-28 05:31:19 [auto1.de] INFO: Saving data for KX26949: {'auction_closing_time': 1774716425.0, 'created_time': 1774552930.450487, 'last_price_update_time': 1774675879.357188}
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX26949') HTTP/1.1" 204 0
2026-03-28 05:31:19 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-28 05:31:19 [auto1.de] INFO: Found listing with ID: CV06251
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV06251%27 HTTP/1.1" 200 None
2026-03-28 05:31:19 [auto1.de] INFO: Scrape type for CV06251: 0
2026-03-28 05:31:19 [auto1.de] INFO: Found listing with ID: NK69314
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK69314%27 HTTP/1.1" 200 None
2026-03-28 05:31:19 [auto1.de] INFO: Scrape type for NK69314: 0
2026-03-28 05:31:19 [auto1.de] INFO: Found listing with ID: EP32297
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP32297%27 HTTP/1.1" 200 None
2026-03-28 05:31:19 [auto1.de] INFO: Scrape type for EP32297: 0
2026-03-28 05:31:19 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-28 05:31:19 [auto1.de] INFO: Scrape type for ZD84444: 0
2026-03-28 05:31:19 [auto1.de] INFO: Found listing with ID: DD38415
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD38415%27 HTTP/1.1" 200 None
2026-03-28 05:31:19 [auto1.de] INFO: Scrape type for DD38415: 2
2026-03-28 05:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7900ebdf-e076-5422-ad48-5d18ada176b4 with identifier: DD38415
2026-03-28 05:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7900ebdf-e076-5422-ad48-5d18ada176b4 with scrape type 2
2026-03-28 05:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7900ebdf-e076-5422-ad48-5d18ada176b4 with scrape type 2
2026-03-28 05:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7900ebdf-e076-5422-ad48-5d18ada176b4, identifier: DD38415
2026-03-28 05:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7900ebdf-e076-5422-ad48-5d18ada176b4 with identifier: DD38415
2026-03-28 05:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7900ebdf-e076-5422-ad48-5d18ada176b4 with identifier: DD38415
2026-03-28 05:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7900ebdf-e076-5422-ad48-5d18ada176b4 with identifier: DD38415 to the API
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:24:59Z',
 'fuel_type': 'petrol',
 'id': '7900ebdf-e076-5422-ad48-5d18ada176b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD38415',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 147636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-03',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD38415%27 HTTP/1.1" 200 None
2026-03-28 05:31:19 [auto1.de] INFO: Saving data for DD38415: {'auction_closing_time': 1774715099.0, 'created_time': 1774551398.887124, 'last_price_update_time': 1774675879.92184}
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD38415') HTTP/1.1" 204 0
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: GC53073
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: JS17929
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS17929%27 HTTP/1.1" 200 None
2026-03-28 05:31:20 [auto1.de] INFO: Scrape type for JS17929: 0
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: GZ10091
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-28 05:31:20 [auto1.de] INFO: Scrape type for RH04581: 2
2026-03-28 05:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 755ad6e8-1745-5673-a185-0a347c03d37d with identifier: RH04581
2026-03-28 05:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 755ad6e8-1745-5673-a185-0a347c03d37d with scrape type 2
2026-03-28 05:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 755ad6e8-1745-5673-a185-0a347c03d37d with scrape type 2
2026-03-28 05:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 755ad6e8-1745-5673-a185-0a347c03d37d, identifier: RH04581
2026-03-28 05:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 755ad6e8-1745-5673-a185-0a347c03d37d with identifier: RH04581
2026-03-28 05:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 755ad6e8-1745-5673-a185-0a347c03d37d with identifier: RH04581
2026-03-28 05:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 755ad6e8-1745-5673-a185-0a347c03d37d with identifier: RH04581 to the API
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:45:01Z',
 'fuel_type': 'diesel',
 'id': '755ad6e8-1745-5673-a185-0a347c03d37d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH04581',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 377125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2012}
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-28 05:31:20 [auto1.de] INFO: Saving data for RH04581: {'auction_closing_time': 1774716301.0, 'created_time': 1774550348.474363, 'last_price_update_time': 1774675880.494788}
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH04581') HTTP/1.1" 204 0
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: KY36378
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-28 05:31:20 [auto1.de] INFO: Scrape type for YS74184: 2
2026-03-28 05:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with identifier: YS74184
2026-03-28 05:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with scrape type 2
2026-03-28 05:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with scrape type 2
2026-03-28 05:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47299e3b-089a-57a1-a3cb-b97a85fe0b20, identifier: YS74184
2026-03-28 05:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with identifier: YS74184
2026-03-28 05:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with identifier: YS74184
2026-03-28 05:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with identifier: YS74184 to the API
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:06:01Z',
 'fuel_type': 'petrol',
 'id': '47299e3b-089a-57a1-a3cb-b97a85fe0b20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS74184',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 115845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-08',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Innovation ecoFlex',
 'transmission': 'automatic',
 'trim': 'Innovation ecoFlex',
 'year': 2018}
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-28 05:31:20 [auto1.de] INFO: Saving data for YS74184: {'auction_closing_time': 1774713961.0, 'created_time': 1774589456.62032, 'last_price_update_time': 1774675880.940172}
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS74184') HTTP/1.1" 204 0
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: EC83870
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC83870%27 HTTP/1.1" 200 None
2026-03-28 05:31:20 [auto1.de] INFO: Scrape type for EC83870: 0
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-28 05:31:20 [auto1.de] INFO: Scrape type for ZN20945: 0
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: CS62800
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-28 05:31:20 [auto1.de] INFO: Found listing with ID: FD48176
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD48176%27 HTTP/1.1" 200 None
2026-03-28 05:31:21 [auto1.de] INFO: Scrape type for FD48176: 2
2026-03-28 05:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc7bd27c-8ddf-5cdf-9386-2a669ee688b3 with identifier: FD48176
2026-03-28 05:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc7bd27c-8ddf-5cdf-9386-2a669ee688b3 with scrape type 2
2026-03-28 05:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc7bd27c-8ddf-5cdf-9386-2a669ee688b3 with scrape type 2
2026-03-28 05:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc7bd27c-8ddf-5cdf-9386-2a669ee688b3, identifier: FD48176
2026-03-28 05:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc7bd27c-8ddf-5cdf-9386-2a669ee688b3 with identifier: FD48176
2026-03-28 05:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc7bd27c-8ddf-5cdf-9386-2a669ee688b3 with identifier: FD48176
2026-03-28 05:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc7bd27c-8ddf-5cdf-9386-2a669ee688b3 with identifier: FD48176 to the API
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:54:55Z',
 'fuel_type': 'petrol',
 'id': 'cc7bd27c-8ddf-5cdf-9386-2a669ee688b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD48176',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 171798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-05',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2014}
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD48176%27 HTTP/1.1" 200 None
2026-03-28 05:31:21 [auto1.de] INFO: Saving data for FD48176: {'auction_closing_time': 1774716895.0, 'created_time': 1774463627.636432, 'last_price_update_time': 1774675881.437373}
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD48176') HTTP/1.1" 204 0
2026-03-28 05:31:21 [auto1.de] INFO: Found listing with ID: GH78103
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH78103%27 HTTP/1.1" 200 None
2026-03-28 05:31:21 [auto1.de] INFO: Scrape type for GH78103: 0
2026-03-28 05:31:21 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-28 05:31:21 [auto1.de] INFO: Scrape type for HV40211: 2
2026-03-28 05:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc20229b-741a-5c76-8de2-ea7c6714fac5 with identifier: HV40211
2026-03-28 05:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc20229b-741a-5c76-8de2-ea7c6714fac5 with scrape type 2
2026-03-28 05:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc20229b-741a-5c76-8de2-ea7c6714fac5 with scrape type 2
2026-03-28 05:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc20229b-741a-5c76-8de2-ea7c6714fac5, identifier: HV40211
2026-03-28 05:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc20229b-741a-5c76-8de2-ea7c6714fac5 with identifier: HV40211
2026-03-28 05:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc20229b-741a-5c76-8de2-ea7c6714fac5 with identifier: HV40211
2026-03-28 05:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc20229b-741a-5c76-8de2-ea7c6714fac5 with identifier: HV40211 to the API
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:05:31Z',
 'fuel_type': 'petrol',
 'id': 'bc20229b-741a-5c76-8de2-ea7c6714fac5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV40211',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 140783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-28 05:31:21 [auto1.de] INFO: Saving data for HV40211: {'auction_closing_time': 1774713931.0, 'created_time': 1774552693.132467, 'last_price_update_time': 1774675881.990473}
2026-03-28 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV40211') HTTP/1.1" 204 0
2026-03-28 05:31:22 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-28 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-28 05:31:22 [auto1.de] INFO: Scrape type for KY48204: 0
2026-03-28 05:31:22 [auto1.de] INFO: Found listing with ID: BB98508
2026-03-28 05:31:22 [auto1.de] INFO: Found listing with ID: AL65001
2026-03-28 05:31:22 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-28 05:31:22 [auto1.de] INFO: Found listing with ID: UT62176
2026-03-28 05:31:22 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-28 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-28 05:31:22 [auto1.de] INFO: Scrape type for GZ21000: 0
2026-03-28 05:31:22 [auto1.de] INFO: Found listing with ID: VE76243
2026-03-28 05:31:22 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-28 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-28 05:31:22 [auto1.de] INFO: Scrape type for WZ19127: 2
2026-03-28 05:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 430137e8-c68d-55f2-83d8-0856c986558d with identifier: WZ19127
2026-03-28 05:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430137e8-c68d-55f2-83d8-0856c986558d with scrape type 2
2026-03-28 05:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 430137e8-c68d-55f2-83d8-0856c986558d with scrape type 2
2026-03-28 05:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 430137e8-c68d-55f2-83d8-0856c986558d, identifier: WZ19127
2026-03-28 05:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 430137e8-c68d-55f2-83d8-0856c986558d with identifier: WZ19127
2026-03-28 05:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 430137e8-c68d-55f2-83d8-0856c986558d with identifier: WZ19127
2026-03-28 05:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 430137e8-c68d-55f2-83d8-0856c986558d with identifier: WZ19127 to the API
2026-03-28 05:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:26:27Z',
 'fuel_type': 'petrol',
 'id': '430137e8-c68d-55f2-83d8-0856c986558d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ19127',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 191578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-18',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-28 05:31:23 [auto1.de] INFO: Saving data for WZ19127: {'auction_closing_time': 1774715187.0, 'created_time': 1774551951.341281, 'last_price_update_time': 1774675883.27675}
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ19127') HTTP/1.1" 204 0
2026-03-28 05:31:23 [auto1.de] INFO: Found listing with ID: LF06916
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF06916%27 HTTP/1.1" 200 None
2026-03-28 05:31:23 [auto1.de] INFO: Scrape type for LF06916: 0
2026-03-28 05:31:23 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-28 05:31:23 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-28 05:31:23 [auto1.de] INFO: Scrape type for FX32627: 2
2026-03-28 05:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with identifier: FX32627
2026-03-28 05:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with scrape type 2
2026-03-28 05:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with scrape type 2
2026-03-28 05:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a, identifier: FX32627
2026-03-28 05:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with identifier: FX32627
2026-03-28 05:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with identifier: FX32627
2026-03-28 05:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with identifier: FX32627 to the API
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:04:27Z',
 'fuel_type': 'petrol',
 'id': '9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX32627',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 92585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-22',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-28 05:31:23 [auto1.de] INFO: Saving data for FX32627: {'auction_closing_time': 1774713867.0, 'created_time': 1774550660.05661, 'last_price_update_time': 1774675883.735807}
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX32627') HTTP/1.1" 204 0
2026-03-28 05:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:23 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:23 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-28 05:31:23 [auto1.de] INFO: Scrape type for AP07103: 0
2026-03-28 05:31:23 [auto1.de] INFO: Found listing with ID: RT59975
2026-03-28 05:31:23 [auto1.de] INFO: Found listing with ID: BK98649
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK98649%27 HTTP/1.1" 200 None
2026-03-28 05:31:23 [auto1.de] INFO: Scrape type for BK98649: 0
2026-03-28 05:31:23 [auto1.de] INFO: Found listing with ID: EW88282
2026-03-28 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW88282%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for EW88282: 0
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: VN21885
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN21885%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for VN21885: 0
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: PB50731
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB50731%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for PB50731: 2
2026-03-28 05:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a86fae4-b568-5d20-a7e5-c204e933e29e with identifier: PB50731
2026-03-28 05:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a86fae4-b568-5d20-a7e5-c204e933e29e with scrape type 2
2026-03-28 05:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a86fae4-b568-5d20-a7e5-c204e933e29e with scrape type 2
2026-03-28 05:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a86fae4-b568-5d20-a7e5-c204e933e29e, identifier: PB50731
2026-03-28 05:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a86fae4-b568-5d20-a7e5-c204e933e29e with identifier: PB50731
2026-03-28 05:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a86fae4-b568-5d20-a7e5-c204e933e29e with identifier: PB50731
2026-03-28 05:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a86fae4-b568-5d20-a7e5-c204e933e29e with identifier: PB50731 to the API
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:06:01Z',
 'fuel_type': 'petrol',
 'id': '2a86fae4-b568-5d20-a7e5-c204e933e29e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB50731',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 158571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-20',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB50731%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Saving data for PB50731: {'auction_closing_time': 1774713961.0, 'created_time': 1774551072.671232, 'last_price_update_time': 1774675884.440929}
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB50731') HTTP/1.1" 204 0
2026-03-28 05:31:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for EM77424: 0
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for HG38928: 0
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for WT17427: 0
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: PP27281
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: UN02057
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: VR87804
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for VL45063: 0
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: LG37465
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: MH85381
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH85381%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for MH85381: 0
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: AT55034
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT55034%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for AT55034: 0
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for ZT00838: 0
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: HY54013
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54013%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for HY54013: 0
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: PM99393
2026-03-28 05:31:24 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-28 05:31:24 [auto1.de] INFO: Scrape type for AR55742: 2
2026-03-28 05:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d32842-f116-5695-abf0-4d7b89697e3c with identifier: AR55742
2026-03-28 05:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d32842-f116-5695-abf0-4d7b89697e3c with scrape type 2
2026-03-28 05:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54d32842-f116-5695-abf0-4d7b89697e3c with scrape type 2
2026-03-28 05:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54d32842-f116-5695-abf0-4d7b89697e3c, identifier: AR55742
2026-03-28 05:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54d32842-f116-5695-abf0-4d7b89697e3c with identifier: AR55742
2026-03-28 05:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54d32842-f116-5695-abf0-4d7b89697e3c with identifier: AR55742
2026-03-28 05:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54d32842-f116-5695-abf0-4d7b89697e3c with identifier: AR55742 to the API
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:35:19Z',
 'fuel_type': 'petrol',
 'id': '54d32842-f116-5695-abf0-4d7b89697e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR55742',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 122769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-25',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2008}
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-28 05:31:25 [auto1.de] INFO: Saving data for AR55742: {'auction_closing_time': 1774715719.0, 'created_time': 1774550443.24556, 'last_price_update_time': 1774675885.011423}
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR55742') HTTP/1.1" 204 0
2026-03-28 05:31:25 [auto1.de] INFO: Found listing with ID: KV84716
2026-03-28 05:31:25 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-28 05:31:25 [auto1.de] INFO: Scrape type for LW43520: 0
2026-03-28 05:31:25 [auto1.de] INFO: Found listing with ID: FD57756
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD57756%27 HTTP/1.1" 200 None
2026-03-28 05:31:25 [auto1.de] INFO: Scrape type for FD57756: 2
2026-03-28 05:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ec77c18-e7eb-5871-8188-75a621b43945 with identifier: FD57756
2026-03-28 05:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ec77c18-e7eb-5871-8188-75a621b43945 with scrape type 2
2026-03-28 05:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ec77c18-e7eb-5871-8188-75a621b43945 with scrape type 2
2026-03-28 05:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ec77c18-e7eb-5871-8188-75a621b43945, identifier: FD57756
2026-03-28 05:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ec77c18-e7eb-5871-8188-75a621b43945 with identifier: FD57756
2026-03-28 05:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ec77c18-e7eb-5871-8188-75a621b43945 with identifier: FD57756
2026-03-28 05:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ec77c18-e7eb-5871-8188-75a621b43945 with identifier: FD57756 to the API
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:23:31Z',
 'fuel_type': 'petrol',
 'id': '3ec77c18-e7eb-5871-8188-75a621b43945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD57756',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 26262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2024}
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD57756%27 HTTP/1.1" 200 None
2026-03-28 05:31:25 [auto1.de] INFO: Saving data for FD57756: {'auction_closing_time': 1774715011.0, 'created_time': 1774552759.376627, 'last_price_update_time': 1774675885.841956}
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD57756') HTTP/1.1" 204 0
2026-03-28 05:31:25 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-28 05:31:25 [auto1.de] INFO: Scrape type for YH26863: 0
2026-03-28 05:31:25 [auto1.de] INFO: Found listing with ID: PY40149
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY40149%27 HTTP/1.1" 200 None
2026-03-28 05:31:25 [auto1.de] INFO: Scrape type for PY40149: 0
2026-03-28 05:31:25 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-28 05:31:25 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-28 05:31:25 [auto1.de] INFO: Scrape type for DJ54071: 0
2026-03-28 05:31:25 [auto1.de] INFO: Found listing with ID: DL36324
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL36324%27 HTTP/1.1" 200 None
2026-03-28 05:31:25 [auto1.de] INFO: Scrape type for DL36324: 0
2026-03-28 05:31:25 [auto1.de] INFO: Found listing with ID: PP65062
2026-03-28 05:31:25 [auto1.de] INFO: Found listing with ID: KM25194
2026-03-28 05:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:26 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:26 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-28 05:31:26 [auto1.de] INFO: Found listing with ID: RK08384
2026-03-28 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK08384%27 HTTP/1.1" 200 None
2026-03-28 05:31:26 [auto1.de] INFO: Scrape type for RK08384: 0
2026-03-28 05:31:26 [auto1.de] INFO: Found listing with ID: LV91095
2026-03-28 05:31:26 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-28 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-28 05:31:26 [auto1.de] INFO: Scrape type for SM03586: 2
2026-03-28 05:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with identifier: SM03586
2026-03-28 05:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with scrape type 2
2026-03-28 05:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with scrape type 2
2026-03-28 05:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c39d5f9-e202-5c18-9c23-b7fcb2161354, identifier: SM03586
2026-03-28 05:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with identifier: SM03586
2026-03-28 05:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with identifier: SM03586
2026-03-28 05:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with identifier: SM03586 to the API
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:34:37Z',
 'fuel_type': 'petrol',
 'id': '5c39d5f9-e202-5c18-9c23-b7fcb2161354',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM03586',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 105014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-03',
 'seller_name': None,
 'title': 'BMW 5er 530i Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2017}
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-28 05:31:27 [auto1.de] INFO: Saving data for SM03586: {'auction_closing_time': 1774715677.0, 'created_time': 1774552842.056626, 'last_price_update_time': 1774675887.311529}
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM03586') HTTP/1.1" 204 0
2026-03-28 05:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:27 [auto1.de] INFO: Found listing with ID: PF34298
2026-03-28 05:31:27 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-28 05:31:27 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-28 05:31:27 [auto1.de] INFO: Found listing with ID: UG55505
2026-03-28 05:31:27 [auto1.de] INFO: Found listing with ID: JX74637
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX74637%27 HTTP/1.1" 200 None
2026-03-28 05:31:27 [auto1.de] INFO: Scrape type for JX74637: 0
2026-03-28 05:31:27 [auto1.de] INFO: Found listing with ID: MH26074
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH26074%27 HTTP/1.1" 200 None
2026-03-28 05:31:27 [auto1.de] INFO: Scrape type for MH26074: 0
2026-03-28 05:31:27 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-28 05:31:27 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-28 05:31:27 [auto1.de] INFO: Scrape type for WK06356: 2
2026-03-28 05:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with identifier: WK06356
2026-03-28 05:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with scrape type 2
2026-03-28 05:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with scrape type 2
2026-03-28 05:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 084aae98-6b1f-5c3f-b581-97bbe5a20d92, identifier: WK06356
2026-03-28 05:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with identifier: WK06356
2026-03-28 05:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with identifier: WK06356
2026-03-28 05:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with identifier: WK06356 to the API
2026-03-28 05:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:21Z',
 'fuel_type': 'petrol',
 'id': '084aae98-6b1f-5c3f-b581-97bbe5a20d92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK06356',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 32580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Tour',
 'transmission': 'automatic',
 'trim': 'Tour',
 'year': 2023}
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Saving data for WK06356: {'auction_closing_time': 1774714761.0, 'created_time': 1773946466.818053, 'last_price_update_time': 1774675888.28578}
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK06356') HTTP/1.1" 204 0
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: LR13115
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR13115%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Scrape type for LR13115: 0
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: XL27476
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL27476%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Scrape type for XL27476: 0
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: ZN11262
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN11262%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Scrape type for ZN11262: 0
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: ZE37210
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE37210%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Scrape type for ZE37210: 0
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: SD08227
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: XA31743
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA31743%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Scrape type for XA31743: 0
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: BS93461
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS93461%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Scrape type for BS93461: 0
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: YH28050
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: EE18812
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Scrape type for EN73396: 0
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: JA88667
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA88667%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Scrape type for JA88667: 2
2026-03-28 05:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bec34e7-a245-571b-83be-b866438598e2 with identifier: JA88667
2026-03-28 05:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bec34e7-a245-571b-83be-b866438598e2 with scrape type 2
2026-03-28 05:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bec34e7-a245-571b-83be-b866438598e2 with scrape type 2
2026-03-28 05:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bec34e7-a245-571b-83be-b866438598e2, identifier: JA88667
2026-03-28 05:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bec34e7-a245-571b-83be-b866438598e2 with identifier: JA88667
2026-03-28 05:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bec34e7-a245-571b-83be-b866438598e2 with identifier: JA88667
2026-03-28 05:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bec34e7-a245-571b-83be-b866438598e2 with identifier: JA88667 to the API
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:54:03Z',
 'fuel_type': 'petrol',
 'id': '4bec34e7-a245-571b-83be-b866438598e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA88667',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 76121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-06',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2015}
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA88667%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Saving data for JA88667: {'auction_closing_time': 1774716843.0, 'created_time': 1773307741.805354, 'last_price_update_time': 1774675888.852927}
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA88667') HTTP/1.1" 204 0
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: LX13795
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: XA47491
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Scrape type for ZJ17739: 0
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: KL79977
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: VL10469
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL10469%27 HTTP/1.1" 200 None
2026-03-28 05:31:28 [auto1.de] INFO: Scrape type for VL10469: 0
2026-03-28 05:31:28 [auto1.de] INFO: Found listing with ID: WZ55342
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ55342%27 HTTP/1.1" 200 None
2026-03-28 05:31:29 [auto1.de] INFO: Scrape type for WZ55342: 0
2026-03-28 05:31:29 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-28 05:31:29 [auto1.de] INFO: Scrape type for NS09930: 2
2026-03-28 05:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c58a07fd-335a-57e8-95eb-284799fbaf25 with identifier: NS09930
2026-03-28 05:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c58a07fd-335a-57e8-95eb-284799fbaf25 with scrape type 2
2026-03-28 05:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c58a07fd-335a-57e8-95eb-284799fbaf25 with scrape type 2
2026-03-28 05:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c58a07fd-335a-57e8-95eb-284799fbaf25, identifier: NS09930
2026-03-28 05:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c58a07fd-335a-57e8-95eb-284799fbaf25 with identifier: NS09930
2026-03-28 05:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c58a07fd-335a-57e8-95eb-284799fbaf25 with identifier: NS09930
2026-03-28 05:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c58a07fd-335a-57e8-95eb-284799fbaf25 with identifier: NS09930 to the API
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:14:01Z',
 'fuel_type': 'petrol',
 'id': 'c58a07fd-335a-57e8-95eb-284799fbaf25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS09930',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 80661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-10',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-28 05:31:29 [auto1.de] INFO: Saving data for NS09930: {'auction_closing_time': 1774714441.0, 'created_time': 1774553017.001279, 'last_price_update_time': 1774675889.421066}
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS09930') HTTP/1.1" 204 0
2026-03-28 05:31:29 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC00063%27 HTTP/1.1" 200 None
2026-03-28 05:31:29 [auto1.de] INFO: Scrape type for SC00063: 0
2026-03-28 05:31:29 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-28 05:31:29 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-28 05:31:29 [auto1.de] INFO: Found listing with ID: NJ70051
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ70051%27 HTTP/1.1" 200 None
2026-03-28 05:31:29 [auto1.de] INFO: Scrape type for NJ70051: 0
2026-03-28 05:31:29 [auto1.de] INFO: Found listing with ID: YJ74621
2026-03-28 05:31:29 [auto1.de] INFO: Found listing with ID: XY04556
2026-03-28 05:31:29 [auto1.de] INFO: Found listing with ID: GN33962
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33962%27 HTTP/1.1" 200 None
2026-03-28 05:31:29 [auto1.de] INFO: Scrape type for GN33962: 0
2026-03-28 05:31:29 [auto1.de] INFO: Found listing with ID: CH37782
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH37782%27 HTTP/1.1" 200 None
2026-03-28 05:31:29 [auto1.de] INFO: Scrape type for CH37782: 0
2026-03-28 05:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:30 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:30 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-28 05:31:30 [auto1.de] INFO: Found listing with ID: TH10598
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH10598%27 HTTP/1.1" 200 None
2026-03-28 05:31:30 [auto1.de] INFO: Scrape type for TH10598: 2
2026-03-28 05:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8d8b96-f249-549f-bb10-983e3bad3ccd with identifier: TH10598
2026-03-28 05:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8d8b96-f249-549f-bb10-983e3bad3ccd with scrape type 2
2026-03-28 05:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8d8b96-f249-549f-bb10-983e3bad3ccd with scrape type 2
2026-03-28 05:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a8d8b96-f249-549f-bb10-983e3bad3ccd, identifier: TH10598
2026-03-28 05:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a8d8b96-f249-549f-bb10-983e3bad3ccd with identifier: TH10598
2026-03-28 05:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a8d8b96-f249-549f-bb10-983e3bad3ccd with identifier: TH10598
2026-03-28 05:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a8d8b96-f249-549f-bb10-983e3bad3ccd with identifier: TH10598 to the API
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:14:17Z',
 'fuel_type': 'petrol',
 'id': '2a8d8b96-f249-549f-bb10-983e3bad3ccd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH10598',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 66425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH10598%27 HTTP/1.1" 200 None
2026-03-28 05:31:30 [auto1.de] INFO: Saving data for TH10598: {'auction_closing_time': 1774714457.0, 'created_time': 1774552664.887491, 'last_price_update_time': 1774675890.759267}
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH10598') HTTP/1.1" 204 0
2026-03-28 05:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:30 [auto1.de] INFO: Found listing with ID: KE28324
2026-03-28 05:31:30 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-28 05:31:30 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-28 05:31:30 [auto1.de] INFO: Scrape type for CF84548: 0
2026-03-28 05:31:30 [auto1.de] INFO: Found listing with ID: WC60331
2026-03-28 05:31:30 [auto1.de] INFO: Found listing with ID: WP53621
2026-03-28 05:31:30 [auto1.de] INFO: Found listing with ID: AL02035
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL02035%27 HTTP/1.1" 200 None
2026-03-28 05:31:30 [auto1.de] INFO: Scrape type for AL02035: 2
2026-03-28 05:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32f292ae-ca93-51f3-8c2e-43d1698a07a3 with identifier: AL02035
2026-03-28 05:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f292ae-ca93-51f3-8c2e-43d1698a07a3 with scrape type 2
2026-03-28 05:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32f292ae-ca93-51f3-8c2e-43d1698a07a3 with scrape type 2
2026-03-28 05:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32f292ae-ca93-51f3-8c2e-43d1698a07a3, identifier: AL02035
2026-03-28 05:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32f292ae-ca93-51f3-8c2e-43d1698a07a3 with identifier: AL02035
2026-03-28 05:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32f292ae-ca93-51f3-8c2e-43d1698a07a3 with identifier: AL02035
2026-03-28 05:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32f292ae-ca93-51f3-8c2e-43d1698a07a3 with identifier: AL02035 to the API
2026-03-28 05:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:12:28Z',
 'fuel_type': 'petrol',
 'id': '32f292ae-ca93-51f3-8c2e-43d1698a07a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL02035',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 145836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-31',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.4 Urban Style',
 'transmission': 'manual',
 'trim': 'Urban Style',
 'year': 2011}
2026-03-28 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL02035%27 HTTP/1.1" 200 None
2026-03-28 05:31:31 [auto1.de] INFO: Saving data for AL02035: {'auction_closing_time': 1774714348.0, 'created_time': 1774551871.881753, 'last_price_update_time': 1774675891.757832}
2026-03-28 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL02035') HTTP/1.1" 204 0
2026-03-28 05:31:31 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-28 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-28 05:31:31 [auto1.de] INFO: Scrape type for UL11229: 0
2026-03-28 05:31:31 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-28 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-28 05:31:31 [auto1.de] INFO: Scrape type for VY54552: 2
2026-03-28 05:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552
2026-03-28 05:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7881bd4-c71c-5250-8725-b543f5a04d69 with scrape type 2
2026-03-28 05:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7881bd4-c71c-5250-8725-b543f5a04d69 with scrape type 2
2026-03-28 05:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7881bd4-c71c-5250-8725-b543f5a04d69, identifier: VY54552
2026-03-28 05:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552
2026-03-28 05:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552
2026-03-28 05:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552 to the API
2026-03-28 05:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:48:24Z',
 'fuel_type': 'hybrid',
 'id': 'e7881bd4-c71c-5250-8725-b543f5a04d69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY54552',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 66959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-02',
 'seller_name': None,
 'title': 'Audi A3 Sportback 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-28 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-28 05:31:32 [auto1.de] INFO: Saving data for VY54552: {'auction_closing_time': 1774716504.0, 'created_time': 1773305616.558535, 'last_price_update_time': 1774675892.806265}
2026-03-28 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY54552') HTTP/1.1" 204 0
2026-03-28 05:31:32 [auto1.de] INFO: Found listing with ID: UP80986
2026-03-28 05:31:32 [auto1.de] INFO: Found listing with ID: YT12471
2026-03-28 05:31:32 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-28 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-28 05:31:32 [auto1.de] INFO: Scrape type for ZB74366: 2
2026-03-28 05:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49ce627d-c6e8-5c78-92b6-29624c1ca007 with identifier: ZB74366
2026-03-28 05:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49ce627d-c6e8-5c78-92b6-29624c1ca007 with scrape type 2
2026-03-28 05:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49ce627d-c6e8-5c78-92b6-29624c1ca007 with scrape type 2
2026-03-28 05:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49ce627d-c6e8-5c78-92b6-29624c1ca007, identifier: ZB74366
2026-03-28 05:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49ce627d-c6e8-5c78-92b6-29624c1ca007 with identifier: ZB74366
2026-03-28 05:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49ce627d-c6e8-5c78-92b6-29624c1ca007 with identifier: ZB74366
2026-03-28 05:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49ce627d-c6e8-5c78-92b6-29624c1ca007 with identifier: ZB74366 to the API
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:45Z',
 'fuel_type': 'diesel',
 'id': '49ce627d-c6e8-5c78-92b6-29624c1ca007',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB74366',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 332391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-28 05:31:33 [auto1.de] INFO: Saving data for ZB74366: {'auction_closing_time': 1774716705.0, 'created_time': 1774552712.769136, 'last_price_update_time': 1774675893.266018}
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB74366') HTTP/1.1" 204 0
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-28 05:31:33 [auto1.de] INFO: Scrape type for TD17986: 0
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: KJ32312
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ32312%27 HTTP/1.1" 200 None
2026-03-28 05:31:33 [auto1.de] INFO: Scrape type for KJ32312: 0
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: UJ67578
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: BT20350
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT20350%27 HTTP/1.1" 200 None
2026-03-28 05:31:33 [auto1.de] INFO: Scrape type for BT20350: 0
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-28 05:31:33 [auto1.de] INFO: Scrape type for NH67676: 0
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: TV15766
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV15766%27 HTTP/1.1" 200 None
2026-03-28 05:31:33 [auto1.de] INFO: Scrape type for TV15766: 0
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: JT25631
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT25631%27 HTTP/1.1" 200 None
2026-03-28 05:31:33 [auto1.de] INFO: Scrape type for JT25631: 2
2026-03-28 05:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d87c455e-f8c3-5d25-b45b-dca4ba578224 with identifier: JT25631
2026-03-28 05:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d87c455e-f8c3-5d25-b45b-dca4ba578224 with scrape type 2
2026-03-28 05:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d87c455e-f8c3-5d25-b45b-dca4ba578224 with scrape type 2
2026-03-28 05:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d87c455e-f8c3-5d25-b45b-dca4ba578224, identifier: JT25631
2026-03-28 05:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d87c455e-f8c3-5d25-b45b-dca4ba578224 with identifier: JT25631
2026-03-28 05:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d87c455e-f8c3-5d25-b45b-dca4ba578224 with identifier: JT25631
2026-03-28 05:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d87c455e-f8c3-5d25-b45b-dca4ba578224 with identifier: JT25631 to the API
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:51:58Z',
 'fuel_type': 'hybrid',
 'id': 'd87c455e-f8c3-5d25-b45b-dca4ba578224',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT25631',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 76003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2020}
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT25631%27 HTTP/1.1" 200 None
2026-03-28 05:31:33 [auto1.de] INFO: Saving data for JT25631: {'auction_closing_time': 1774716718.0, 'created_time': 1774463715.414486, 'last_price_update_time': 1774675893.875117}
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT25631') HTTP/1.1" 204 0
2026-03-28 05:31:33 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-28 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-28 05:31:34 [auto1.de] INFO: Scrape type for FD74109: 2
2026-03-28 05:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with identifier: FD74109
2026-03-28 05:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with scrape type 2
2026-03-28 05:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with scrape type 2
2026-03-28 05:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b6d1112-d52a-5da6-bd3a-91c1d9098432, identifier: FD74109
2026-03-28 05:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with identifier: FD74109
2026-03-28 05:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with identifier: FD74109
2026-03-28 05:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with identifier: FD74109 to the API
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:12:45Z',
 'fuel_type': 'petrol',
 'id': '1b6d1112-d52a-5da6-bd3a-91c1d9098432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD74109',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 172917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-04',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 2.0 Ocean',
 'transmission': 'manual',
 'trim': 'Ocean',
 'year': 2005}
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-28 05:31:34 [auto1.de] INFO: Saving data for FD74109: {'auction_closing_time': 1774714365.0, 'created_time': 1774550117.511419, 'last_price_update_time': 1774675894.40889}
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD74109') HTTP/1.1" 204 0
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: VT28358
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT28358%27 HTTP/1.1" 200 None
2026-03-28 05:31:34 [auto1.de] INFO: Scrape type for VT28358: 0
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: BY14776
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: BH50029
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH50029%27 HTTP/1.1" 200 None
2026-03-28 05:31:34 [auto1.de] INFO: Scrape type for BH50029: 0
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-28 05:31:34 [auto1.de] INFO: Scrape type for LC33794: 0
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: FG40376
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: LU76842
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: JA95391
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA95391%27 HTTP/1.1" 200 None
2026-03-28 05:31:34 [auto1.de] INFO: Scrape type for JA95391: 0
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: DF25786
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: RL14403
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: PU08613
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU08613%27 HTTP/1.1" 200 None
2026-03-28 05:31:34 [auto1.de] INFO: Scrape type for PU08613: 0
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: VM29679
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: DS79921
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS79921%27 HTTP/1.1" 200 None
2026-03-28 05:31:34 [auto1.de] INFO: Scrape type for DS79921: 0
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: YM33158
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM33158%27 HTTP/1.1" 200 None
2026-03-28 05:31:34 [auto1.de] INFO: Scrape type for YM33158: 0
2026-03-28 05:31:34 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-28 05:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:35 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:35 [auto1.de] INFO: Found listing with ID: JZ03470
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ03470%27 HTTP/1.1" 200 None
2026-03-28 05:31:35 [auto1.de] INFO: Scrape type for JZ03470: 0
2026-03-28 05:31:35 [auto1.de] INFO: Found listing with ID: YV00461
2026-03-28 05:31:35 [auto1.de] INFO: Found listing with ID: RP49857
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP49857%27 HTTP/1.1" 200 None
2026-03-28 05:31:35 [auto1.de] INFO: Scrape type for RP49857: 0
2026-03-28 05:31:35 [auto1.de] INFO: Found listing with ID: WR52929
2026-03-28 05:31:35 [auto1.de] INFO: Found listing with ID: UM76329
2026-03-28 05:31:35 [auto1.de] INFO: Found listing with ID: PE28100
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE28100%27 HTTP/1.1" 200 None
2026-03-28 05:31:35 [auto1.de] INFO: Scrape type for PE28100: 2
2026-03-28 05:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 225df199-c513-5816-8c09-d3d030f6de02 with identifier: PE28100
2026-03-28 05:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 225df199-c513-5816-8c09-d3d030f6de02 with scrape type 2
2026-03-28 05:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 225df199-c513-5816-8c09-d3d030f6de02 with scrape type 2
2026-03-28 05:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 225df199-c513-5816-8c09-d3d030f6de02, identifier: PE28100
2026-03-28 05:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 225df199-c513-5816-8c09-d3d030f6de02 with identifier: PE28100
2026-03-28 05:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 225df199-c513-5816-8c09-d3d030f6de02 with identifier: PE28100
2026-03-28 05:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 225df199-c513-5816-8c09-d3d030f6de02 with identifier: PE28100 to the API
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:59:52Z',
 'fuel_type': 'petrol',
 'id': '225df199-c513-5816-8c09-d3d030f6de02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE28100',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 121878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-06',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2016}
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE28100%27 HTTP/1.1" 200 None
2026-03-28 05:31:35 [auto1.de] INFO: Saving data for PE28100: {'auction_closing_time': 1774717192.0, 'created_time': 1773138572.007234, 'last_price_update_time': 1774675895.768253}
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE28100') HTTP/1.1" 204 0
2026-03-28 05:31:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:35 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-28 05:31:35 [auto1.de] INFO: Scrape type for EB81332: 2
2026-03-28 05:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 873ecf28-8bd2-57e6-a9cf-67607f60a489 with identifier: EB81332
2026-03-28 05:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 873ecf28-8bd2-57e6-a9cf-67607f60a489 with scrape type 2
2026-03-28 05:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 873ecf28-8bd2-57e6-a9cf-67607f60a489 with scrape type 2
2026-03-28 05:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 873ecf28-8bd2-57e6-a9cf-67607f60a489, identifier: EB81332
2026-03-28 05:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 873ecf28-8bd2-57e6-a9cf-67607f60a489 with identifier: EB81332
2026-03-28 05:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 873ecf28-8bd2-57e6-a9cf-67607f60a489 with identifier: EB81332
2026-03-28 05:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 873ecf28-8bd2-57e6-a9cf-67607f60a489 with identifier: EB81332 to the API
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-28T16:04:41Z',
 'fuel_type': 'petrol',
 'id': '873ecf28-8bd2-57e6-a9cf-67607f60a489',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB81332',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 126108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-27',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TSI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2017}
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-28 05:31:36 [auto1.de] INFO: Saving data for EB81332: {'auction_closing_time': 1774713881.0, 'created_time': 1774551111.038421, 'last_price_update_time': 1774675896.318274}
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB81332') HTTP/1.1" 204 0
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: VC21534
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20018%27 HTTP/1.1" 200 None
2026-03-28 05:31:36 [auto1.de] INFO: Scrape type for MA20018: 0
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-28 05:31:36 [auto1.de] INFO: Scrape type for RE36292: 0
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: CM07244
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: FT76728
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: ES78783
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: ZY80626
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: SZ29379
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: LK88331
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK88331%27 HTTP/1.1" 200 None
2026-03-28 05:31:36 [auto1.de] INFO: Scrape type for LK88331: 2
2026-03-28 05:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c69848ad-5c64-5733-b8e0-120fb678779c with identifier: LK88331
2026-03-28 05:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c69848ad-5c64-5733-b8e0-120fb678779c with scrape type 2
2026-03-28 05:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c69848ad-5c64-5733-b8e0-120fb678779c with scrape type 2
2026-03-28 05:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c69848ad-5c64-5733-b8e0-120fb678779c, identifier: LK88331
2026-03-28 05:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c69848ad-5c64-5733-b8e0-120fb678779c with identifier: LK88331
2026-03-28 05:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c69848ad-5c64-5733-b8e0-120fb678779c with identifier: LK88331
2026-03-28 05:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c69848ad-5c64-5733-b8e0-120fb678779c with identifier: LK88331 to the API
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-28T16:39:08Z',
 'fuel_type': 'diesel',
 'id': 'c69848ad-5c64-5733-b8e0-120fb678779c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK88331',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 125771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-12',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2019}
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK88331%27 HTTP/1.1" 200 None
2026-03-28 05:31:36 [auto1.de] INFO: Saving data for LK88331: {'auction_closing_time': 1774715948.0, 'created_time': 1773225074.779652, 'last_price_update_time': 1774675896.831131}
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK88331') HTTP/1.1" 204 0
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: JG57844
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: WR65399
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: MH95241
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95241%27 HTTP/1.1" 200 None
2026-03-28 05:31:36 [auto1.de] INFO: Scrape type for MH95241: 0
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: MJ83876
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: DX81242
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX81242%27 HTTP/1.1" 200 None
2026-03-28 05:31:36 [auto1.de] INFO: Scrape type for DX81242: 0
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: MF03650
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: DE69503
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: SE45637
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: CW35231
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: UT80766
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: MP12786
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: PG06608
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG06608%27 HTTP/1.1" 200 None
2026-03-28 05:31:36 [auto1.de] INFO: Scrape type for PG06608: 0
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: BA53965
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: BM06383
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: XL53582
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: CC01881
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC01881%27 HTTP/1.1" 200 None
2026-03-28 05:31:36 [auto1.de] INFO: Scrape type for CC01881: 0
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: VA45757
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: DH52741
2026-03-28 05:31:36 [auto1.de] INFO: Found listing with ID: AL76969
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL76969%27 HTTP/1.1" 200 None
2026-03-28 05:31:36 [auto1.de] INFO: Scrape type for AL76969: 2
2026-03-28 05:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02cfed3d-49f7-5def-b3b1-27ed98ea19bd with identifier: AL76969
2026-03-28 05:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02cfed3d-49f7-5def-b3b1-27ed98ea19bd with scrape type 2
2026-03-28 05:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02cfed3d-49f7-5def-b3b1-27ed98ea19bd with scrape type 2
2026-03-28 05:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02cfed3d-49f7-5def-b3b1-27ed98ea19bd, identifier: AL76969
2026-03-28 05:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02cfed3d-49f7-5def-b3b1-27ed98ea19bd with identifier: AL76969
2026-03-28 05:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02cfed3d-49f7-5def-b3b1-27ed98ea19bd with identifier: AL76969
2026-03-28 05:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02cfed3d-49f7-5def-b3b1-27ed98ea19bd with identifier: AL76969 to the API
2026-03-28 05:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:22Z',
 'fuel_type': 'diesel',
 'id': '02cfed3d-49f7-5def-b3b1-27ed98ea19bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL76969',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 240661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-30',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D3 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2013}
2026-03-28 05:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL76969%27 HTTP/1.1" 200 None
2026-03-28 05:31:37 [auto1.de] INFO: Saving data for AL76969: {'auction_closing_time': 1774716262.0, 'created_time': 1774550500.104024, 'last_price_update_time': 1774675897.342172}
2026-03-28 05:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL76969') HTTP/1.1" 204 0
2026-03-28 05:31:37 [auto1.de] INFO: Found listing with ID: LS93174
2026-03-28 05:31:37 [auto1.de] INFO: Found listing with ID: UM55631
2026-03-28 05:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:43 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: US98158
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US98158%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for US98158: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: XZ97961
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: AZ98687
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: MX80513
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX80513%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for MX80513: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: SP10962
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: DL48053
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: MH16408
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: XW43121
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for WL40040: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: WN08657
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: WJ49334
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for MR38870: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: CX66529
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: KA23374
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA23374%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for KA23374: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: NR02271
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR02271%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for NR02271: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: ZC85664
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: DJ88162
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: BY78150
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: KT69264
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT69264%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for KT69264: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: GZ46428
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ46428%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for GZ46428: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for VS79881: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: VU46856
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU46856%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for VU46856: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: YH17193
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: BU83638
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for EN93789: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: HR39540
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: RS35479
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for EW47494: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for JB50627: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: WC43161
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: YM50991
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: JG32595
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG32595%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for JG32595: 0
2026-03-28 05:31:43 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Scrape type for EN74445: 2
2026-03-28 05:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445
2026-03-28 05:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with scrape type 2
2026-03-28 05:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with scrape type 2
2026-03-28 05:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82, identifier: EN74445
2026-03-28 05:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445
2026-03-28 05:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445
2026-03-28 05:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445 to the API
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:25:06Z',
 'fuel_type': 'diesel',
 'id': 'f06bf916-8ec8-5711-b2a5-0d9f6da2dd82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN74445',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 117852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-28 05:31:43 [auto1.de] INFO: Saving data for EN74445: {'auction_closing_time': 1774715106.0, 'created_time': 1773225163.627787, 'last_price_update_time': 1774675903.770448}
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN74445') HTTP/1.1" 204 0
2026-03-28 05:31:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:45 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:45 [auto1.de] INFO: Found listing with ID: WK54006
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK54006%27 HTTP/1.1" 200 None
2026-03-28 05:31:45 [auto1.de] INFO: Scrape type for WK54006: 0
2026-03-28 05:31:45 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-28 05:31:45 [auto1.de] INFO: Scrape type for KE52706: 2
2026-03-28 05:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aa3eba1-3705-5202-8838-deeabf5f0e04 with identifier: KE52706
2026-03-28 05:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aa3eba1-3705-5202-8838-deeabf5f0e04 with scrape type 2
2026-03-28 05:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8aa3eba1-3705-5202-8838-deeabf5f0e04 with scrape type 2
2026-03-28 05:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8aa3eba1-3705-5202-8838-deeabf5f0e04, identifier: KE52706
2026-03-28 05:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8aa3eba1-3705-5202-8838-deeabf5f0e04 with identifier: KE52706
2026-03-28 05:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8aa3eba1-3705-5202-8838-deeabf5f0e04 with identifier: KE52706
2026-03-28 05:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8aa3eba1-3705-5202-8838-deeabf5f0e04 with identifier: KE52706 to the API
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:50:13Z',
 'fuel_type': 'petrol',
 'id': '8aa3eba1-3705-5202-8838-deeabf5f0e04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE52706',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 67280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-22',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-28 05:31:45 [auto1.de] INFO: Saving data for KE52706: {'auction_closing_time': 1774716613.0, 'created_time': 1774552701.799171, 'last_price_update_time': 1774675905.565955}
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE52706') HTTP/1.1" 204 0
2026-03-28 05:31:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:45 [auto1.de] INFO: Found listing with ID: LZ37842
2026-03-28 05:31:45 [auto1.de] INFO: Found listing with ID: VG17915
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG17915%27 HTTP/1.1" 200 None
2026-03-28 05:31:45 [auto1.de] INFO: Scrape type for VG17915: 0
2026-03-28 05:31:45 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-28 05:31:45 [auto1.de] INFO: Found listing with ID: TD10276
2026-03-28 05:31:45 [auto1.de] INFO: Found listing with ID: EG12940
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG12940%27 HTTP/1.1" 200 None
2026-03-28 05:31:45 [auto1.de] INFO: Scrape type for EG12940: 0
2026-03-28 05:31:45 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-28 05:31:45 [auto1.de] INFO: Scrape type for CW13893: 2
2026-03-28 05:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with identifier: CW13893
2026-03-28 05:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with scrape type 2
2026-03-28 05:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with scrape type 2
2026-03-28 05:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0, identifier: CW13893
2026-03-28 05:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with identifier: CW13893
2026-03-28 05:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with identifier: CW13893
2026-03-28 05:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with identifier: CW13893 to the API
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:22:34Z',
 'fuel_type': 'petrol',
 'id': 'f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW13893',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 169296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'automatic',
 'trim': 'Match',
 'year': 2012}
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-28 05:31:46 [auto1.de] INFO: Saving data for CW13893: {'auction_closing_time': 1774714954.0, 'created_time': 1774589455.789927, 'last_price_update_time': 1774675906.064014}
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW13893') HTTP/1.1" 204 0
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: TZ50604
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: LB13606
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: AT93996
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: TX27115
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX27115%27 HTTP/1.1" 200 None
2026-03-28 05:31:46 [auto1.de] INFO: Scrape type for TX27115: 0
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: WX48966
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-28 05:31:46 [auto1.de] INFO: Scrape type for XW48128: 2
2026-03-28 05:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128
2026-03-28 05:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54948df8-0462-5578-8152-550b90091500 with scrape type 2
2026-03-28 05:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54948df8-0462-5578-8152-550b90091500 with scrape type 2
2026-03-28 05:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54948df8-0462-5578-8152-550b90091500, identifier: XW48128
2026-03-28 05:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128
2026-03-28 05:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128
2026-03-28 05:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128 to the API
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:32:02Z',
 'fuel_type': 'petrol',
 'id': '54948df8-0462-5578-8152-550b90091500',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW48128',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 158463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-17',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Sports-Line',
 'transmission': 'automatic',
 'trim': 'Sports-Line',
 'year': 2016}
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-28 05:31:46 [auto1.de] INFO: Saving data for XW48128: {'auction_closing_time': 1774715522.0, 'created_time': 1773307964.489466, 'last_price_update_time': 1774675906.506177}
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW48128') HTTP/1.1" 204 0
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-28 05:31:46 [auto1.de] INFO: Scrape type for SF00681: 0
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: UT79910
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT79910%27 HTTP/1.1" 200 None
2026-03-28 05:31:46 [auto1.de] INFO: Scrape type for UT79910: 0
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-28 05:31:46 [auto1.de] INFO: Scrape type for VY57936: 0
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: PD39203
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-28 05:31:46 [auto1.de] INFO: Scrape type for DG23161: 0
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: AN31553
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN31553%27 HTTP/1.1" 200 None
2026-03-28 05:31:46 [auto1.de] INFO: Scrape type for AN31553: 0
2026-03-28 05:31:46 [auto1.de] INFO: Found listing with ID: FC70862
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC70862%27 HTTP/1.1" 200 None
2026-03-28 05:31:46 [auto1.de] INFO: Scrape type for FC70862: 2
2026-03-28 05:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ab9c8d8-5f53-5c9a-8296-44344d21ebda with identifier: FC70862
2026-03-28 05:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ab9c8d8-5f53-5c9a-8296-44344d21ebda with scrape type 2
2026-03-28 05:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ab9c8d8-5f53-5c9a-8296-44344d21ebda with scrape type 2
2026-03-28 05:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ab9c8d8-5f53-5c9a-8296-44344d21ebda, identifier: FC70862
2026-03-28 05:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ab9c8d8-5f53-5c9a-8296-44344d21ebda with identifier: FC70862
2026-03-28 05:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ab9c8d8-5f53-5c9a-8296-44344d21ebda with identifier: FC70862
2026-03-28 05:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ab9c8d8-5f53-5c9a-8296-44344d21ebda with identifier: FC70862 to the API
2026-03-28 05:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:40Z',
 'fuel_type': 'petrol',
 'id': '2ab9c8d8-5f53-5c9a-8296-44344d21ebda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC70862',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 53104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-18',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC70862%27 HTTP/1.1" 200 None
2026-03-28 05:31:47 [auto1.de] INFO: Saving data for FC70862: {'auction_closing_time': 1774716040.0, 'created_time': 1773660514.456042, 'last_price_update_time': 1774675907.125548}
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC70862') HTTP/1.1" 204 0
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: WL01890
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL01890%27 HTTP/1.1" 200 None
2026-03-28 05:31:47 [auto1.de] INFO: Scrape type for WL01890: 0
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: AG44550
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: UH79601
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: KY88001
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY88001%27 HTTP/1.1" 200 None
2026-03-28 05:31:47 [auto1.de] INFO: Scrape type for KY88001: 0
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: LH02136
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-28 05:31:47 [auto1.de] INFO: Scrape type for HZ20287: 2
2026-03-28 05:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with identifier: HZ20287
2026-03-28 05:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with scrape type 2
2026-03-28 05:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with scrape type 2
2026-03-28 05:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e, identifier: HZ20287
2026-03-28 05:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with identifier: HZ20287
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 05:31:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with identifier: HZ20287
2026-03-28 05:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with identifier: HZ20287 to the API
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:45:05Z',
 'fuel_type': 'petrol',
 'id': '61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ20287',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 61032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-17',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2014}
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-28 05:31:47 [auto1.de] INFO: Saving data for HZ20287: {'auction_closing_time': 1774716305.0, 'created_time': 1774552873.156279, 'last_price_update_time': 1774675907.735996}
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ20287') HTTP/1.1" 204 0
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD15809%27 HTTP/1.1" 200 None
2026-03-28 05:31:47 [auto1.de] INFO: Scrape type for LD15809: 0
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: BU66338
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU66338%27 HTTP/1.1" 200 None
2026-03-28 05:31:47 [auto1.de] INFO: Scrape type for BU66338: 0
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: YK08772
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK08772%27 HTTP/1.1" 200 None
2026-03-28 05:31:47 [auto1.de] INFO: Scrape type for YK08772: 0
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: YV33202
2026-03-28 05:31:47 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-28 05:31:47 [auto1.de] INFO: Scrape type for PK18306: 2
2026-03-28 05:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47691d87-ba9c-5bec-b060-2a76eb1509ae with identifier: PK18306
2026-03-28 05:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47691d87-ba9c-5bec-b060-2a76eb1509ae with scrape type 2
2026-03-28 05:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47691d87-ba9c-5bec-b060-2a76eb1509ae with scrape type 2
2026-03-28 05:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47691d87-ba9c-5bec-b060-2a76eb1509ae, identifier: PK18306
2026-03-28 05:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47691d87-ba9c-5bec-b060-2a76eb1509ae with identifier: PK18306
2026-03-28 05:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47691d87-ba9c-5bec-b060-2a76eb1509ae with identifier: PK18306
2026-03-28 05:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47691d87-ba9c-5bec-b060-2a76eb1509ae with identifier: PK18306 to the API
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:17:06Z',
 'fuel_type': 'diesel',
 'id': '47691d87-ba9c-5bec-b060-2a76eb1509ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK18306',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 171524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2020}
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-28 05:31:48 [auto1.de] INFO: Saving data for PK18306: {'auction_closing_time': 1774714626.0, 'created_time': 1774552977.236686, 'last_price_update_time': 1774675908.303945}
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK18306') HTTP/1.1" 204 0
2026-03-28 05:31:48 [auto1.de] INFO: Found listing with ID: PY30467
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30467%27 HTTP/1.1" 200 None
2026-03-28 05:31:48 [auto1.de] INFO: Scrape type for PY30467: 0
2026-03-28 05:31:48 [auto1.de] INFO: Found listing with ID: DK13262
2026-03-28 05:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:48 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:48 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-28 05:31:48 [auto1.de] INFO: Scrape type for NE62435: 2
2026-03-28 05:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with identifier: NE62435
2026-03-28 05:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with scrape type 2
2026-03-28 05:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with scrape type 2
2026-03-28 05:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3, identifier: NE62435
2026-03-28 05:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with identifier: NE62435
2026-03-28 05:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with identifier: NE62435
2026-03-28 05:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with identifier: NE62435 to the API
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 387,
 'expiration_date': '2026-03-28T16:40:38Z',
 'fuel_type': 'petrol',
 'id': '915c1b0d-1b89-5ee6-9f1e-3794bbe57da3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE62435',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 180312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-01',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-28 05:31:48 [auto1.de] INFO: Saving data for NE62435: {'auction_closing_time': 1774716038.0, 'created_time': 1774552430.430519, 'last_price_update_time': 1774675908.882842}
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE62435') HTTP/1.1" 204 0
2026-03-28 05:31:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:48 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-28 05:31:48 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-28 05:31:48 [auto1.de] INFO: Scrape type for HA16942: 0
2026-03-28 05:31:48 [auto1.de] INFO: Found listing with ID: GD02743
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02743%27 HTTP/1.1" 200 None
2026-03-28 05:31:48 [auto1.de] INFO: Scrape type for GD02743: 2
2026-03-28 05:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8e65d40-fa6d-5aa9-bcff-b1b6221c7a3f with identifier: GD02743
2026-03-28 05:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8e65d40-fa6d-5aa9-bcff-b1b6221c7a3f with scrape type 2
2026-03-28 05:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8e65d40-fa6d-5aa9-bcff-b1b6221c7a3f with scrape type 2
2026-03-28 05:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8e65d40-fa6d-5aa9-bcff-b1b6221c7a3f, identifier: GD02743
2026-03-28 05:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8e65d40-fa6d-5aa9-bcff-b1b6221c7a3f with identifier: GD02743
2026-03-28 05:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8e65d40-fa6d-5aa9-bcff-b1b6221c7a3f with identifier: GD02743
2026-03-28 05:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8e65d40-fa6d-5aa9-bcff-b1b6221c7a3f with identifier: GD02743 to the API
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:19:07Z',
 'fuel_type': 'diesel',
 'id': 'b8e65d40-fa6d-5aa9-bcff-b1b6221c7a3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD02743',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 200735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-06-30',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi FT 300 Mittel',
 'transmission': 'manual',
 'trim': 'FT 300 Mittel',
 'year': 2002}
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02743%27 HTTP/1.1" 200 None
2026-03-28 05:31:49 [auto1.de] INFO: Saving data for GD02743: {'auction_closing_time': 1774714747.0, 'created_time': 1774467627.715308, 'last_price_update_time': 1774675909.3336}
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD02743') HTTP/1.1" 204 0
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: LF00427
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: MY00361
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: FP43907
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP43907%27 HTTP/1.1" 200 None
2026-03-28 05:31:49 [auto1.de] INFO: Scrape type for FP43907: 0
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: MH07331
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: HL85444
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: JW50887
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW50887%27 HTTP/1.1" 200 None
2026-03-28 05:31:49 [auto1.de] INFO: Scrape type for JW50887: 0
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: NV12597
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV12597%27 HTTP/1.1" 200 None
2026-03-28 05:31:49 [auto1.de] INFO: Scrape type for NV12597: 0
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: XM88485
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: XT03032
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-28 05:31:49 [auto1.de] INFO: Scrape type for NG74955: 0
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: MW79572
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79572%27 HTTP/1.1" 200 None
2026-03-28 05:31:49 [auto1.de] INFO: Scrape type for MW79572: 0
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: VF88904
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF88904%27 HTTP/1.1" 200 None
2026-03-28 05:31:49 [auto1.de] INFO: Scrape type for VF88904: 0
2026-03-28 05:31:49 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-28 05:31:49 [auto1.de] INFO: Scrape type for WL56832: 2
2026-03-28 05:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d659cb2e-2763-5c0e-8fc2-44bc2687124d with identifier: WL56832
2026-03-28 05:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d659cb2e-2763-5c0e-8fc2-44bc2687124d with scrape type 2
2026-03-28 05:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d659cb2e-2763-5c0e-8fc2-44bc2687124d with scrape type 2
2026-03-28 05:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d659cb2e-2763-5c0e-8fc2-44bc2687124d, identifier: WL56832
2026-03-28 05:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d659cb2e-2763-5c0e-8fc2-44bc2687124d with identifier: WL56832
2026-03-28 05:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d659cb2e-2763-5c0e-8fc2-44bc2687124d with identifier: WL56832
2026-03-28 05:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d659cb2e-2763-5c0e-8fc2-44bc2687124d with identifier: WL56832 to the API
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:32:02Z',
 'fuel_type': 'petrol',
 'id': 'd659cb2e-2763-5c0e-8fc2-44bc2687124d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL56832',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 55278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-22',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI R-Line',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-28 05:31:49 [auto1.de] INFO: Saving data for WL56832: {'auction_closing_time': 1774715522.0, 'created_time': 1774552780.195991, 'last_price_update_time': 1774675909.96326}
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL56832') HTTP/1.1" 204 0
2026-03-28 05:31:50 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-28 05:31:50 [auto1.de] INFO: Scrape type for GG07111: 2
2026-03-28 05:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d2e1449-8fef-5224-b434-cd4c3f222b6a with identifier: GG07111
2026-03-28 05:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d2e1449-8fef-5224-b434-cd4c3f222b6a with scrape type 2
2026-03-28 05:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d2e1449-8fef-5224-b434-cd4c3f222b6a with scrape type 2
2026-03-28 05:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d2e1449-8fef-5224-b434-cd4c3f222b6a, identifier: GG07111
2026-03-28 05:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d2e1449-8fef-5224-b434-cd4c3f222b6a with identifier: GG07111
2026-03-28 05:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d2e1449-8fef-5224-b434-cd4c3f222b6a with identifier: GG07111
2026-03-28 05:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d2e1449-8fef-5224-b434-cd4c3f222b6a with identifier: GG07111 to the API
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:16:28Z',
 'fuel_type': 'petrol',
 'id': '2d2e1449-8fef-5224-b434-cd4c3f222b6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG07111',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 118466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-26',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-28 05:31:50 [auto1.de] INFO: Saving data for GG07111: {'auction_closing_time': 1774714588.0, 'created_time': 1774550198.958044, 'last_price_update_time': 1774675910.483647}
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG07111') HTTP/1.1" 204 0
2026-03-28 05:31:50 [auto1.de] INFO: Found listing with ID: XB94191
2026-03-28 05:31:50 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-28 05:31:50 [auto1.de] INFO: Scrape type for FP97739: 0
2026-03-28 05:31:50 [auto1.de] INFO: Found listing with ID: KY82766
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY82766%27 HTTP/1.1" 200 None
2026-03-28 05:31:50 [auto1.de] INFO: Scrape type for KY82766: 0
2026-03-28 05:31:50 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-28 05:31:50 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW57830%27 HTTP/1.1" 200 None
2026-03-28 05:31:50 [auto1.de] INFO: Scrape type for CW57830: 2
2026-03-28 05:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830
2026-03-28 05:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35f96e5-5799-5631-b461-1088215b4928 with scrape type 2
2026-03-28 05:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35f96e5-5799-5631-b461-1088215b4928 with scrape type 2
2026-03-28 05:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b35f96e5-5799-5631-b461-1088215b4928, identifier: CW57830
2026-03-28 05:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830
2026-03-28 05:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830
2026-03-28 05:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830 to the API
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:22:04Z',
 'fuel_type': 'diesel',
 'id': 'b35f96e5-5799-5631-b461-1088215b4928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW57830',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 157571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW57830%27 HTTP/1.1" 200 None
2026-03-28 05:31:50 [auto1.de] INFO: Saving data for CW57830: {'auction_closing_time': 1774714924.0, 'created_time': 1773304704.963808, 'last_price_update_time': 1774675910.953617}
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW57830') HTTP/1.1" 204 0
2026-03-28 05:31:50 [auto1.de] INFO: Found listing with ID: TP36932
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP36932%27 HTTP/1.1" 200 None
2026-03-28 05:31:50 [auto1.de] INFO: Scrape type for TP36932: 0
2026-03-28 05:31:50 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK49782%27 HTTP/1.1" 200 None
2026-03-28 05:31:50 [auto1.de] INFO: Scrape type for HK49782: 0
2026-03-28 05:31:50 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-28 05:31:50 [auto1.de] INFO: Found listing with ID: TC07570
2026-03-28 05:31:50 [auto1.de] INFO: Found listing with ID: XT11627
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT11627%27 HTTP/1.1" 200 None
2026-03-28 05:31:51 [auto1.de] INFO: Scrape type for XT11627: 0
2026-03-28 05:31:51 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-28 05:31:51 [auto1.de] INFO: Found listing with ID: AT18561
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT18561%27 HTTP/1.1" 200 None
2026-03-28 05:31:51 [auto1.de] INFO: Scrape type for AT18561: 0
2026-03-28 05:31:51 [auto1.de] INFO: Found listing with ID: ZY97327
2026-03-28 05:31:51 [auto1.de] INFO: Found listing with ID: ES68106
2026-03-28 05:31:51 [auto1.de] INFO: Found listing with ID: PV88809
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV88809%27 HTTP/1.1" 200 None
2026-03-28 05:31:51 [auto1.de] INFO: Scrape type for PV88809: 2
2026-03-28 05:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c84385d9-57f4-5ead-9c26-360962d77b9f with identifier: PV88809
2026-03-28 05:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c84385d9-57f4-5ead-9c26-360962d77b9f with scrape type 2
2026-03-28 05:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c84385d9-57f4-5ead-9c26-360962d77b9f with scrape type 2
2026-03-28 05:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c84385d9-57f4-5ead-9c26-360962d77b9f, identifier: PV88809
2026-03-28 05:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c84385d9-57f4-5ead-9c26-360962d77b9f with identifier: PV88809
2026-03-28 05:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c84385d9-57f4-5ead-9c26-360962d77b9f with identifier: PV88809
2026-03-28 05:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c84385d9-57f4-5ead-9c26-360962d77b9f with identifier: PV88809 to the API
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:54:45Z',
 'fuel_type': 'petrol',
 'id': 'c84385d9-57f4-5ead-9c26-360962d77b9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV88809',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 132262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV88809%27 HTTP/1.1" 200 None
2026-03-28 05:31:51 [auto1.de] INFO: Saving data for PV88809: {'auction_closing_time': 1774716885.0, 'created_time': 1772542224.737322, 'last_price_update_time': 1774675911.497334}
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV88809') HTTP/1.1" 204 0
2026-03-28 05:31:51 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-28 05:31:51 [auto1.de] INFO: Scrape type for TV33488: 0
2026-03-28 05:31:51 [auto1.de] INFO: Found listing with ID: GP39031
2026-03-28 05:31:51 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-28 05:31:51 [auto1.de] INFO: Scrape type for WA19353: 0
2026-03-28 05:31:51 [auto1.de] INFO: Found listing with ID: ZM28041
2026-03-28 05:31:51 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-28 05:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:53 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: WZ91552
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ91552%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Scrape type for WZ91552: 0
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: TA55344
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA55344%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Scrape type for TA55344: 0
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: VH13590
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH13590%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Scrape type for VH13590: 0
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: TU13960
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: LA33826
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA33826%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Scrape type for LA33826: 0
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: KA93370
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA93370%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Scrape type for KA93370: 0
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Scrape type for CP06642: 2
2026-03-28 05:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642
2026-03-28 05:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with scrape type 2
2026-03-28 05:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with scrape type 2
2026-03-28 05:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b, identifier: CP06642
2026-03-28 05:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642
2026-03-28 05:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642
2026-03-28 05:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642 to the API
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:49:11Z',
 'fuel_type': 'petrol',
 'id': '14486fe4-9ea4-5ea5-9b46-ebb33e56808b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP06642',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 56773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Saving data for CP06642: {'auction_closing_time': 1774716551.0, 'created_time': 1773132241.051774, 'last_price_update_time': 1774675913.694362}
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP06642') HTTP/1.1" 204 0
2026-03-28 05:31:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: SY11471
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11471%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Scrape type for SY11471: 0
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: YU32339
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU32339%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Scrape type for YU32339: 0
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: GL86487
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL86487%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Scrape type for GL86487: 0
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: SY69766
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY69766%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Scrape type for SY69766: 0
2026-03-28 05:31:53 [auto1.de] INFO: Found listing with ID: TN44984
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN44984%27 HTTP/1.1" 200 None
2026-03-28 05:31:53 [auto1.de] INFO: Scrape type for TN44984: 2
2026-03-28 05:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b24be3-9658-5211-b26b-d9fb121d38fa with identifier: TN44984
2026-03-28 05:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b24be3-9658-5211-b26b-d9fb121d38fa with scrape type 2
2026-03-28 05:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63b24be3-9658-5211-b26b-d9fb121d38fa with scrape type 2
2026-03-28 05:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63b24be3-9658-5211-b26b-d9fb121d38fa, identifier: TN44984
2026-03-28 05:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63b24be3-9658-5211-b26b-d9fb121d38fa with identifier: TN44984
2026-03-28 05:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63b24be3-9658-5211-b26b-d9fb121d38fa with identifier: TN44984
2026-03-28 05:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63b24be3-9658-5211-b26b-d9fb121d38fa with identifier: TN44984 to the API
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:43Z',
 'fuel_type': 'petrol',
 'id': '63b24be3-9658-5211-b26b-d9fb121d38fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN44984',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 137916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-06',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2018}
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN44984%27 HTTP/1.1" 200 None
2026-03-28 05:31:54 [auto1.de] INFO: Saving data for TN44984: {'auction_closing_time': 1774714963.0, 'created_time': 1774552785.853746, 'last_price_update_time': 1774675914.301317}
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN44984') HTTP/1.1" 204 0
2026-03-28 05:31:54 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-28 05:31:54 [auto1.de] INFO: Scrape type for MX47183: 2
2026-03-28 05:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 705f438c-3e95-5458-8353-b91f71d78d0e with identifier: MX47183
2026-03-28 05:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 705f438c-3e95-5458-8353-b91f71d78d0e with scrape type 2
2026-03-28 05:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 705f438c-3e95-5458-8353-b91f71d78d0e with scrape type 2
2026-03-28 05:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 705f438c-3e95-5458-8353-b91f71d78d0e, identifier: MX47183
2026-03-28 05:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 705f438c-3e95-5458-8353-b91f71d78d0e with identifier: MX47183
2026-03-28 05:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 705f438c-3e95-5458-8353-b91f71d78d0e with identifier: MX47183
2026-03-28 05:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 705f438c-3e95-5458-8353-b91f71d78d0e with identifier: MX47183 to the API
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:19:40Z',
 'fuel_type': 'petrol',
 'id': '705f438c-3e95-5458-8353-b91f71d78d0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX47183',
 'listing': 'auction',
 'make': 'Borgward',
 'model': 'BX7',
 'odometer': 98951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-22',
 'seller_name': None,
 'title': 'Borgward BX7 2.0 TGDI TS Limited Edition',
 'transmission': 'automatic',
 'trim': 'TS Limited Edition',
 'year': 2018}
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-28 05:31:54 [auto1.de] INFO: Saving data for MX47183: {'auction_closing_time': 1774714780.0, 'created_time': 1774552333.440733, 'last_price_update_time': 1774675914.736907}
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX47183') HTTP/1.1" 204 0
2026-03-28 05:31:54 [auto1.de] INFO: Found listing with ID: LB62140
2026-03-28 05:31:54 [auto1.de] INFO: Found listing with ID: WT89497
2026-03-28 05:31:54 [auto1.de] INFO: Found listing with ID: VC12091
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC12091%27 HTTP/1.1" 200 None
2026-03-28 05:31:54 [auto1.de] INFO: Scrape type for VC12091: 2
2026-03-28 05:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf85286-a53c-5577-9a24-fdaf8e405c4f with identifier: VC12091
2026-03-28 05:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf85286-a53c-5577-9a24-fdaf8e405c4f with scrape type 2
2026-03-28 05:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cf85286-a53c-5577-9a24-fdaf8e405c4f with scrape type 2
2026-03-28 05:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cf85286-a53c-5577-9a24-fdaf8e405c4f, identifier: VC12091
2026-03-28 05:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cf85286-a53c-5577-9a24-fdaf8e405c4f with identifier: VC12091
2026-03-28 05:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cf85286-a53c-5577-9a24-fdaf8e405c4f with identifier: VC12091
2026-03-28 05:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cf85286-a53c-5577-9a24-fdaf8e405c4f with identifier: VC12091 to the API
2026-03-28 05:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:57:18Z',
 'fuel_type': 'petrol',
 'id': '1cf85286-a53c-5577-9a24-fdaf8e405c4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC12091',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 157630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-21',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Family Plus',
 'transmission': 'manual',
 'trim': 'Family Plus',
 'year': 2012}
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC12091%27 HTTP/1.1" 200 None
2026-03-28 05:31:55 [auto1.de] INFO: Saving data for VC12091: {'auction_closing_time': 1774717038.0, 'created_time': 1773741417.53153, 'last_price_update_time': 1774675915.170036}
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC12091') HTTP/1.1" 204 0
2026-03-28 05:31:55 [auto1.de] INFO: Found listing with ID: HN27316
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN27316%27 HTTP/1.1" 200 None
2026-03-28 05:31:55 [auto1.de] INFO: Scrape type for HN27316: 2
2026-03-28 05:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0660b2a7-cf54-5f06-8fce-ac4547fbbde0 with identifier: HN27316
2026-03-28 05:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0660b2a7-cf54-5f06-8fce-ac4547fbbde0 with scrape type 2
2026-03-28 05:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0660b2a7-cf54-5f06-8fce-ac4547fbbde0 with scrape type 2
2026-03-28 05:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0660b2a7-cf54-5f06-8fce-ac4547fbbde0, identifier: HN27316
2026-03-28 05:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0660b2a7-cf54-5f06-8fce-ac4547fbbde0 with identifier: HN27316
2026-03-28 05:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0660b2a7-cf54-5f06-8fce-ac4547fbbde0 with identifier: HN27316
2026-03-28 05:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0660b2a7-cf54-5f06-8fce-ac4547fbbde0 with identifier: HN27316 to the API
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:27:15Z',
 'fuel_type': 'diesel',
 'id': '0660b2a7-cf54-5f06-8fce-ac4547fbbde0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN27316',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 164161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-13',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2019}
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN27316%27 HTTP/1.1" 200 None
2026-03-28 05:31:55 [auto1.de] INFO: Saving data for HN27316: {'auction_closing_time': 1774715235.0, 'created_time': 1773687548.490923, 'last_price_update_time': 1774675915.63105}
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN27316') HTTP/1.1" 204 0
2026-03-28 05:31:55 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-28 05:31:55 [auto1.de] INFO: Scrape type for LW48006: 0
2026-03-28 05:31:55 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-28 05:31:55 [auto1.de] INFO: Scrape type for MH82914: 2
2026-03-28 05:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd638ca1-45a3-5302-8f49-5046a040de14 with identifier: MH82914
2026-03-28 05:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd638ca1-45a3-5302-8f49-5046a040de14 with scrape type 2
2026-03-28 05:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd638ca1-45a3-5302-8f49-5046a040de14 with scrape type 2
2026-03-28 05:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd638ca1-45a3-5302-8f49-5046a040de14, identifier: MH82914
2026-03-28 05:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd638ca1-45a3-5302-8f49-5046a040de14 with identifier: MH82914
2026-03-28 05:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd638ca1-45a3-5302-8f49-5046a040de14 with identifier: MH82914
2026-03-28 05:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd638ca1-45a3-5302-8f49-5046a040de14 with identifier: MH82914 to the API
2026-03-28 05:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:38:35Z',
 'fuel_type': 'diesel',
 'id': 'dd638ca1-45a3-5302-8f49-5046a040de14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH82914',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 204962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-18',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-28 05:31:56 [auto1.de] INFO: Saving data for MH82914: {'auction_closing_time': 1774715915.0, 'created_time': 1774550447.722065, 'last_price_update_time': 1774675916.185101}
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH82914') HTTP/1.1" 204 0
2026-03-28 05:31:56 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-28 05:31:56 [auto1.de] INFO: Scrape type for SY19126: 0
2026-03-28 05:31:56 [auto1.de] INFO: Found listing with ID: HH63715
2026-03-28 05:31:56 [auto1.de] INFO: Found listing with ID: HP91668
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91668%27 HTTP/1.1" 200 None
2026-03-28 05:31:56 [auto1.de] INFO: Scrape type for HP91668: 0
2026-03-28 05:31:56 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-28 05:31:56 [auto1.de] INFO: Scrape type for AG68218: 2
2026-03-28 05:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218
2026-03-28 05:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34a89eef-88d5-59ba-b6f7-bbf703b788ae with scrape type 2
2026-03-28 05:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34a89eef-88d5-59ba-b6f7-bbf703b788ae with scrape type 2
2026-03-28 05:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34a89eef-88d5-59ba-b6f7-bbf703b788ae, identifier: AG68218
2026-03-28 05:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218
2026-03-28 05:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218
2026-03-28 05:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218 to the API
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:18:22Z',
 'fuel_type': 'petrol',
 'id': '34a89eef-88d5-59ba-b6f7-bbf703b788ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG68218',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 93848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-11',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Diamant Edition 2WD',
 'transmission': 'manual',
 'trim': 'Diamant Edition 2WD',
 'year': 2015}
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-28 05:31:56 [auto1.de] INFO: Saving data for AG68218: {'auction_closing_time': 1774714702.0, 'created_time': 1773224937.532251, 'last_price_update_time': 1774675916.749805}
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG68218') HTTP/1.1" 204 0
2026-03-28 05:31:56 [auto1.de] INFO: Found listing with ID: RG80046
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG80046%27 HTTP/1.1" 200 None
2026-03-28 05:31:56 [auto1.de] INFO: Scrape type for RG80046: 0
2026-03-28 05:31:56 [auto1.de] INFO: Found listing with ID: HE16433
2026-03-28 05:31:56 [auto1.de] INFO: Found listing with ID: GD20981
2026-03-28 05:31:56 [auto1.de] INFO: Found listing with ID: WP39257
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP39257%27 HTTP/1.1" 200 None
2026-03-28 05:31:56 [auto1.de] INFO: Scrape type for WP39257: 0
2026-03-28 05:31:56 [auto1.de] INFO: Found listing with ID: SY31818
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY31818%27 HTTP/1.1" 200 None
2026-03-28 05:31:56 [auto1.de] INFO: Scrape type for SY31818: 2
2026-03-28 05:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01755525-4ae6-5ad5-b130-6c01f4cd95a9 with identifier: SY31818
2026-03-28 05:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01755525-4ae6-5ad5-b130-6c01f4cd95a9 with scrape type 2
2026-03-28 05:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01755525-4ae6-5ad5-b130-6c01f4cd95a9 with scrape type 2
2026-03-28 05:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01755525-4ae6-5ad5-b130-6c01f4cd95a9, identifier: SY31818
2026-03-28 05:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01755525-4ae6-5ad5-b130-6c01f4cd95a9 with identifier: SY31818
2026-03-28 05:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01755525-4ae6-5ad5-b130-6c01f4cd95a9 with identifier: SY31818
2026-03-28 05:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01755525-4ae6-5ad5-b130-6c01f4cd95a9 with identifier: SY31818 to the API
2026-03-28 05:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:08:09Z',
 'fuel_type': 'petrol',
 'id': '01755525-4ae6-5ad5-b130-6c01f4cd95a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY31818',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 28350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2018}
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY31818%27 HTTP/1.1" 200 None
2026-03-28 05:31:57 [auto1.de] INFO: Saving data for SY31818: {'auction_closing_time': 1774714089.0, 'created_time': 1774550670.772685, 'last_price_update_time': 1774675917.206335}
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY31818') HTTP/1.1" 204 0
2026-03-28 05:31:57 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-28 05:31:57 [auto1.de] INFO: Scrape type for AU38078: 2
2026-03-28 05:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 711cf0ed-d644-5948-993b-b9e325609017 with identifier: AU38078
2026-03-28 05:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 711cf0ed-d644-5948-993b-b9e325609017 with scrape type 2
2026-03-28 05:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 711cf0ed-d644-5948-993b-b9e325609017 with scrape type 2
2026-03-28 05:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 711cf0ed-d644-5948-993b-b9e325609017, identifier: AU38078
2026-03-28 05:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 711cf0ed-d644-5948-993b-b9e325609017 with identifier: AU38078
2026-03-28 05:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 711cf0ed-d644-5948-993b-b9e325609017 with identifier: AU38078
2026-03-28 05:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 711cf0ed-d644-5948-993b-b9e325609017 with identifier: AU38078 to the API
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:16:18Z',
 'fuel_type': 'petrol',
 'id': '711cf0ed-d644-5948-993b-b9e325609017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU38078',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 75689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-03',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-28 05:31:57 [auto1.de] INFO: Saving data for AU38078: {'auction_closing_time': 1774714578.0, 'created_time': 1774552888.665271, 'last_price_update_time': 1774675917.739858}
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU38078') HTTP/1.1" 204 0
2026-03-28 05:31:57 [auto1.de] INFO: Found listing with ID: LF70646
2026-03-28 05:31:57 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-28 05:31:57 [auto1.de] INFO: Scrape type for WP28886: 2
2026-03-28 05:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7b052b4-6768-57a6-ab3d-960a199513ed with identifier: WP28886
2026-03-28 05:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7b052b4-6768-57a6-ab3d-960a199513ed with scrape type 2
2026-03-28 05:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7b052b4-6768-57a6-ab3d-960a199513ed with scrape type 2
2026-03-28 05:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7b052b4-6768-57a6-ab3d-960a199513ed, identifier: WP28886
2026-03-28 05:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7b052b4-6768-57a6-ab3d-960a199513ed with identifier: WP28886
2026-03-28 05:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7b052b4-6768-57a6-ab3d-960a199513ed with identifier: WP28886
2026-03-28 05:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7b052b4-6768-57a6-ab3d-960a199513ed with identifier: WP28886 to the API
2026-03-28 05:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:49:03Z',
 'fuel_type': 'petrol',
 'id': 'b7b052b4-6768-57a6-ab3d-960a199513ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP28886',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 2658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-14',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Journey',
 'transmission': 'automatic',
 'trim': 'Journey',
 'year': 2025}
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Saving data for WP28886: {'auction_closing_time': 1774716543.0, 'created_time': 1774553065.073039, 'last_price_update_time': 1774675918.210755}
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP28886') HTTP/1.1" 204 0
2026-03-28 05:31:58 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 9199 | hits on page: 40
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: ZZ21826
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ21826%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for ZZ21826: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: GE17394
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for MR72377: 2
2026-03-28 05:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with identifier: MR72377
2026-03-28 05:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with scrape type 2
2026-03-28 05:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with scrape type 2
2026-03-28 05:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8, identifier: MR72377
2026-03-28 05:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with identifier: MR72377
2026-03-28 05:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with identifier: MR72377
2026-03-28 05:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with identifier: MR72377 to the API
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:27:54Z',
 'fuel_type': 'diesel',
 'id': '2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR72377',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 169715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Saving data for MR72377: {'auction_closing_time': 1774715274.0, 'created_time': 1774552145.046006, 'last_price_update_time': 1774675918.690438}
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR72377') HTTP/1.1" 204 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: DC40385
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC40385%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for DC40385: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: ZM52158
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52158%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for ZM52158: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: ZN33524
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: AT13824
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT13824%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for AT13824: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: JM14799
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: BE73867
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE73867%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for BE73867: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: LC46015
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC46015%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for LC46015: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: RJ57220
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ57220%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for RJ57220: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for BD66077: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: XA84499
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: KZ90725
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ90725%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for KZ90725: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for HD47083: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: DH93175
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: LB61549
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB61549%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for LB61549: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: XM69109
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM69109%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for XM69109: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: NU93751
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU93751%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for NU93751: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: JB42175
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: RW58482
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW58482%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for RW58482: 0
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: XJ35206
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: YG99324
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: FJ74613
2026-03-28 05:31:58 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ57335%27 HTTP/1.1" 200 None
2026-03-28 05:31:58 [auto1.de] INFO: Scrape type for WJ57335: 2
2026-03-28 05:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335
2026-03-28 05:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with scrape type 2
2026-03-28 05:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with scrape type 2
2026-03-28 05:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36, identifier: WJ57335
2026-03-28 05:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:31:59 [auto1.de] INFO: Found listing with ID: YE65319
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE65319%27 HTTP/1.1" 200 None
2026-03-28 05:31:59 [auto1.de] INFO: Scrape type for YE65319: 0
2026-03-28 05:31:59 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-28 05:31:59 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-28 05:31:59 [auto1.de] INFO: Scrape type for PC91683: 0
2026-03-28 05:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335
2026-03-28 05:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335
2026-03-28 05:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335 to the API
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:14:23Z',
 'fuel_type': 'diesel',
 'id': '1b933d39-d6dd-5350-8cb3-2ab68ec55a36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ57335',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 231046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-05',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ57335%27 HTTP/1.1" 200 None
2026-03-28 05:31:59 [auto1.de] INFO: Saving data for WJ57335: {'auction_closing_time': 1774714463.0, 'created_time': 1772543141.804452, 'last_price_update_time': 1774675919.385214}
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ57335') HTTP/1.1" 204 0
2026-03-28 05:31:59 [auto1.de] INFO: Found listing with ID: PR99901
2026-03-28 05:31:59 [auto1.de] INFO: Found listing with ID: CM46139
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46139%27 HTTP/1.1" 200 None
2026-03-28 05:31:59 [auto1.de] INFO: Scrape type for CM46139: 2
2026-03-28 05:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe1017fa-bd42-5f6c-ade7-384f96f0d609 with identifier: CM46139
2026-03-28 05:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe1017fa-bd42-5f6c-ade7-384f96f0d609 with scrape type 2
2026-03-28 05:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe1017fa-bd42-5f6c-ade7-384f96f0d609 with scrape type 2
2026-03-28 05:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe1017fa-bd42-5f6c-ade7-384f96f0d609, identifier: CM46139
2026-03-28 05:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe1017fa-bd42-5f6c-ade7-384f96f0d609 with identifier: CM46139
2026-03-28 05:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe1017fa-bd42-5f6c-ade7-384f96f0d609 with identifier: CM46139
2026-03-28 05:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe1017fa-bd42-5f6c-ade7-384f96f0d609 with identifier: CM46139 to the API
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:34:01Z',
 'fuel_type': 'diesel',
 'id': 'fe1017fa-bd42-5f6c-ade7-384f96f0d609',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM46139',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 39570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-30',
 'seller_name': None,
 'title': 'Opel Movano 2.2 CDTI HKa L3H2 3,5t Edition',
 'transmission': 'manual',
 'trim': 'HKa L3H2 3,5t Edition',
 'year': 2024}
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46139%27 HTTP/1.1" 200 None
2026-03-28 05:31:59 [auto1.de] INFO: Saving data for CM46139: {'auction_closing_time': 1774715641.0, 'created_time': 1774550115.565118, 'last_price_update_time': 1774675919.952813}
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM46139') HTTP/1.1" 204 0
2026-03-28 05:31:59 [auto1.de] INFO: Found listing with ID: EJ87927
2026-03-28 05:31:59 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-28 05:31:59 [auto1.de] INFO: Found listing with ID: LE56152
2026-03-28 05:31:59 [auto1.de] INFO: Found listing with ID: TB03254
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03254%27 HTTP/1.1" 200 None
2026-03-28 05:31:59 [auto1.de] INFO: Scrape type for TB03254: 0
2026-03-28 05:31:59 [auto1.de] INFO: Found listing with ID: HG55526
2026-03-28 05:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG55526%27 HTTP/1.1" 200 None
2026-03-28 05:32:00 [auto1.de] INFO: Scrape type for HG55526: 0
2026-03-28 05:32:00 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-28 05:32:00 [auto1.de] INFO: Found listing with ID: EZ42588
2026-03-28 05:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ42588%27 HTTP/1.1" 200 None
2026-03-28 05:32:00 [auto1.de] INFO: Scrape type for EZ42588: 0
2026-03-28 05:32:00 [auto1.de] INFO: Found listing with ID: XP66514
2026-03-28 05:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP66514%27 HTTP/1.1" 200 None
2026-03-28 05:32:00 [auto1.de] INFO: Scrape type for XP66514: 0
2026-03-28 05:32:00 [auto1.de] INFO: Found listing with ID: DL58213
2026-03-28 05:32:00 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-28 05:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:01 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:01 [auto1.de] INFO: Found listing with ID: PV43751
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV43751%27 HTTP/1.1" 200 None
2026-03-28 05:32:01 [auto1.de] INFO: Scrape type for PV43751: 0
2026-03-28 05:32:01 [auto1.de] INFO: Found listing with ID: BZ32388
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ32388%27 HTTP/1.1" 200 None
2026-03-28 05:32:01 [auto1.de] INFO: Scrape type for BZ32388: 0
2026-03-28 05:32:01 [auto1.de] INFO: Found listing with ID: BF01952
2026-03-28 05:32:01 [auto1.de] INFO: Found listing with ID: GR87963
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR87963%27 HTTP/1.1" 200 None
2026-03-28 05:32:01 [auto1.de] INFO: Scrape type for GR87963: 0
2026-03-28 05:32:01 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-28 05:32:01 [auto1.de] INFO: Scrape type for ZJ71499: 2
2026-03-28 05:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with identifier: ZJ71499
2026-03-28 05:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with scrape type 2
2026-03-28 05:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with scrape type 2
2026-03-28 05:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fab48df-72d6-50e0-b811-d2ad8af9ba0d, identifier: ZJ71499
2026-03-28 05:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with identifier: ZJ71499
2026-03-28 05:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with identifier: ZJ71499
2026-03-28 05:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with identifier: ZJ71499 to the API
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:23:32Z',
 'fuel_type': 'petrol',
 'id': '4fab48df-72d6-50e0-b811-d2ad8af9ba0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ71499',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 111503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-28 05:32:01 [auto1.de] INFO: Saving data for ZJ71499: {'auction_closing_time': 1774715012.0, 'created_time': 1774550456.998837, 'last_price_update_time': 1774675921.546935}
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ71499') HTTP/1.1" 204 0
2026-03-28 05:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:01 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-28 05:32:01 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-28 05:32:01 [auto1.de] INFO: Found listing with ID: WZ89922
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ89922%27 HTTP/1.1" 200 None
2026-03-28 05:32:01 [auto1.de] INFO: Scrape type for WZ89922: 0
2026-03-28 05:32:01 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-28 05:32:01 [auto1.de] INFO: Scrape type for HF93741: 2
2026-03-28 05:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with identifier: HF93741
2026-03-28 05:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with scrape type 2
2026-03-28 05:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with scrape type 2
2026-03-28 05:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4, identifier: HF93741
2026-03-28 05:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with identifier: HF93741
2026-03-28 05:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with identifier: HF93741
2026-03-28 05:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with identifier: HF93741 to the API
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-28T16:05:16Z',
 'fuel_type': 'petrol',
 'id': '904ccd4f-3265-5b18-9f7c-2f3a57a57eb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF93741',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 87837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 43 AMG T 4Matic',
 'transmission': 'automatic',
 'trim': 'T 4Matic',
 'year': 2018}
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-28 05:32:02 [auto1.de] INFO: Saving data for HF93741: {'auction_closing_time': 1774713916.0, 'created_time': 1774552978.978507, 'last_price_update_time': 1774675922.107455}
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF93741') HTTP/1.1" 204 0
2026-03-28 05:32:02 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-28 05:32:02 [auto1.de] INFO: Found listing with ID: FX73004
2026-03-28 05:32:02 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-28 05:32:02 [auto1.de] INFO: Found listing with ID: CT28544
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT28544%27 HTTP/1.1" 200 None
2026-03-28 05:32:02 [auto1.de] INFO: Scrape type for CT28544: 2
2026-03-28 05:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c18a6885-4bd1-5699-9ac5-8c665e232be3 with identifier: CT28544
2026-03-28 05:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c18a6885-4bd1-5699-9ac5-8c665e232be3 with scrape type 2
2026-03-28 05:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c18a6885-4bd1-5699-9ac5-8c665e232be3 with scrape type 2
2026-03-28 05:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c18a6885-4bd1-5699-9ac5-8c665e232be3, identifier: CT28544
2026-03-28 05:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c18a6885-4bd1-5699-9ac5-8c665e232be3 with identifier: CT28544
2026-03-28 05:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c18a6885-4bd1-5699-9ac5-8c665e232be3 with identifier: CT28544
2026-03-28 05:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c18a6885-4bd1-5699-9ac5-8c665e232be3 with identifier: CT28544 to the API
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:11:27Z',
 'fuel_type': 'diesel',
 'id': 'c18a6885-4bd1-5699-9ac5-8c665e232be3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT28544',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 220776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-18',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350 d 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2012}
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT28544%27 HTTP/1.1" 200 None
2026-03-28 05:32:02 [auto1.de] INFO: Saving data for CT28544: {'auction_closing_time': 1774714287.0, 'created_time': 1773307224.211841, 'last_price_update_time': 1774675922.569929}
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT28544') HTTP/1.1" 204 0
2026-03-28 05:32:02 [auto1.de] INFO: Found listing with ID: ZZ22411
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ22411%27 HTTP/1.1" 200 None
2026-03-28 05:32:02 [auto1.de] INFO: Scrape type for ZZ22411: 0
2026-03-28 05:32:02 [auto1.de] INFO: Found listing with ID: BC32553
2026-03-28 05:32:02 [auto1.de] INFO: Found listing with ID: TR77666
2026-03-28 05:32:02 [auto1.de] INFO: Found listing with ID: AM57263
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM57263%27 HTTP/1.1" 200 None
2026-03-28 05:32:02 [auto1.de] INFO: Scrape type for AM57263: 0
2026-03-28 05:32:02 [auto1.de] INFO: Found listing with ID: YC31452
2026-03-28 05:32:02 [auto1.de] INFO: Found listing with ID: UT50255
2026-03-28 05:32:02 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-28 05:32:02 [auto1.de] INFO: Scrape type for TL72428: 2
2026-03-28 05:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b94db271-a14b-564f-9aac-dde63c936ee6 with identifier: TL72428
2026-03-28 05:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b94db271-a14b-564f-9aac-dde63c936ee6 with scrape type 2
2026-03-28 05:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b94db271-a14b-564f-9aac-dde63c936ee6 with scrape type 2
2026-03-28 05:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b94db271-a14b-564f-9aac-dde63c936ee6, identifier: TL72428
2026-03-28 05:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b94db271-a14b-564f-9aac-dde63c936ee6 with identifier: TL72428
2026-03-28 05:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b94db271-a14b-564f-9aac-dde63c936ee6 with identifier: TL72428
2026-03-28 05:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b94db271-a14b-564f-9aac-dde63c936ee6 with identifier: TL72428 to the API
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:14:18Z',
 'fuel_type': 'petrol',
 'id': 'b94db271-a14b-564f-9aac-dde63c936ee6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL72428',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 182687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2015}
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Saving data for TL72428: {'auction_closing_time': 1774714458.0, 'created_time': 1774552959.874613, 'last_price_update_time': 1774675923.069191}
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL72428') HTTP/1.1" 204 0
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: SN29778
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN29778%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Scrape type for SN29778: 0
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: FY31029
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY31029%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Scrape type for FY31029: 0
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: NW62557
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62557%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Scrape type for NW62557: 0
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: KV92241
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: VE56470
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE56470%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Scrape type for VE56470: 0
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: ZD16653
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: FL10476
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: FT17472
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT17472%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Scrape type for FT17472: 0
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: HW55427
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: AT91043
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT91043%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Scrape type for AT91043: 2
2026-03-28 05:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a74d6a8-e261-51d7-b4e8-1da0863ec26b with identifier: AT91043
2026-03-28 05:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a74d6a8-e261-51d7-b4e8-1da0863ec26b with scrape type 2
2026-03-28 05:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a74d6a8-e261-51d7-b4e8-1da0863ec26b with scrape type 2
2026-03-28 05:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a74d6a8-e261-51d7-b4e8-1da0863ec26b, identifier: AT91043
2026-03-28 05:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a74d6a8-e261-51d7-b4e8-1da0863ec26b with identifier: AT91043
2026-03-28 05:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a74d6a8-e261-51d7-b4e8-1da0863ec26b with identifier: AT91043
2026-03-28 05:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a74d6a8-e261-51d7-b4e8-1da0863ec26b with identifier: AT91043 to the API
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:42Z',
 'fuel_type': 'petrol',
 'id': '4a74d6a8-e261-51d7-b4e8-1da0863ec26b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT91043',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 84887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-22',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT91043%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Saving data for AT91043: {'auction_closing_time': 1774716162.0, 'created_time': 1774552184.11359, 'last_price_update_time': 1774675923.686099}
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT91043') HTTP/1.1" 204 0
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: XU94698
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU94698%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Scrape type for XU94698: 0
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: HA89318
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: VF29678
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: TX14113
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX14113%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Scrape type for TX14113: 0
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: HU68643
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68643%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Scrape type for HU68643: 0
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-28 05:32:03 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-28 05:32:03 [auto1.de] INFO: Scrape type for PJ17742: 2
2026-03-28 05:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with identifier: PJ17742
2026-03-28 05:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with scrape type 2
2026-03-28 05:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with scrape type 2
2026-03-28 05:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b12165d9-7293-57eb-a68a-f2d7f0a75fc8, identifier: PJ17742
2026-03-28 05:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with identifier: PJ17742
2026-03-28 05:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with identifier: PJ17742
2026-03-28 05:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with identifier: PJ17742 to the API
2026-03-28 05:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:47:59Z',
 'fuel_type': 'diesel',
 'id': 'b12165d9-7293-57eb-a68a-f2d7f0a75fc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ17742',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 84862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seller_name': None,
 'title': 'Opel Grandland X 1.5 CDTI INNOVATION',
 'transmission': 'automatic',
 'trim': 'INNOVATION',
 'year': 2019}
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-28 05:32:04 [auto1.de] INFO: Saving data for PJ17742: {'auction_closing_time': 1774716479.0, 'created_time': 1774550349.250902, 'last_price_update_time': 1774675924.179483}
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ17742') HTTP/1.1" 204 0
2026-03-28 05:32:04 [auto1.de] INFO: Found listing with ID: SV18640
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18640%27 HTTP/1.1" 200 None
2026-03-28 05:32:04 [auto1.de] INFO: Scrape type for SV18640: 0
2026-03-28 05:32:04 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-28 05:32:04 [auto1.de] INFO: Scrape type for DU69800: 2
2026-03-28 05:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f92a7736-d900-550e-972c-ab6033fe255c with identifier: DU69800
2026-03-28 05:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f92a7736-d900-550e-972c-ab6033fe255c with scrape type 2
2026-03-28 05:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f92a7736-d900-550e-972c-ab6033fe255c with scrape type 2
2026-03-28 05:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f92a7736-d900-550e-972c-ab6033fe255c, identifier: DU69800
2026-03-28 05:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f92a7736-d900-550e-972c-ab6033fe255c with identifier: DU69800
2026-03-28 05:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f92a7736-d900-550e-972c-ab6033fe255c with identifier: DU69800
2026-03-28 05:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f92a7736-d900-550e-972c-ab6033fe255c with identifier: DU69800 to the API
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:20Z',
 'fuel_type': 'petrol',
 'id': 'f92a7736-d900-550e-972c-ab6033fe255c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU69800',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 143898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-28 05:32:04 [auto1.de] INFO: Saving data for DU69800: {'auction_closing_time': 1774714760.0, 'created_time': 1774550636.732956, 'last_price_update_time': 1774675924.767711}
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU69800') HTTP/1.1" 204 0
2026-03-28 05:32:04 [auto1.de] INFO: Found listing with ID: KU76096
2026-03-28 05:32:06 [scrapy.extensions.logstats] INFO: Crawled 55 pages (at 15 pages/min), scraped 113 items (at 72 items/min)
2026-03-28 05:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:07 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: XM76659
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM76659%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Scrape type for XM76659: 0
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: NG64881
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: WB57730
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB57730%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Scrape type for WB57730: 0
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Scrape type for YF32306: 0
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: TD78857
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: WB68702
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: BK48500
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK48500%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Scrape type for BK48500: 0
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: TA30581
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: ES90262
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES90262%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Scrape type for ES90262: 0
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: KH17356
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: KG51970
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG51970%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Scrape type for KG51970: 0
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: RT76696
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76696%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Scrape type for RT76696: 0
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: XL57324
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Scrape type for GJ82118: 2
2026-03-28 05:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with identifier: GJ82118
2026-03-28 05:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with scrape type 2
2026-03-28 05:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with scrape type 2
2026-03-28 05:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1, identifier: GJ82118
2026-03-28 05:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with identifier: GJ82118
2026-03-28 05:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with identifier: GJ82118
2026-03-28 05:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with identifier: GJ82118 to the API
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:50:18Z',
 'fuel_type': 'diesel',
 'id': '3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ82118',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 153606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-27',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Multivan',
 'transmission': 'automatic',
 'trim': 'Multivan',
 'year': 2012}
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Saving data for GJ82118: {'auction_closing_time': 1774716618.0, 'created_time': 1774551859.088054, 'last_price_update_time': 1774675927.697944}
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ82118') HTTP/1.1" 204 0
2026-03-28 05:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: PK52215
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK52215%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Scrape type for PK52215: 0
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: SV40404
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV40404%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Scrape type for SV40404: 0
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: WH62381
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: AG00767
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: GJ42826
2026-03-28 05:32:07 [auto1.de] INFO: Found listing with ID: EL91919
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91919%27 HTTP/1.1" 200 None
2026-03-28 05:32:07 [auto1.de] INFO: Scrape type for EL91919: 2
2026-03-28 05:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with identifier: EL91919
2026-03-28 05:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with scrape type 2
2026-03-28 05:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with scrape type 2
2026-03-28 05:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34e2fa4a-109d-526e-909f-bf4c1996e2a8, identifier: EL91919
2026-03-28 05:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with identifier: EL91919
2026-03-28 05:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with identifier: EL91919
2026-03-28 05:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34e2fa4a-109d-526e-909f-bf4c1996e2a8 with identifier: EL91919 to the API
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:41:38Z',
 'fuel_type': 'diesel',
 'id': '34e2fa4a-109d-526e-909f-bf4c1996e2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL91919',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 177678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-09',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2015}
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91919%27 HTTP/1.1" 200 None
2026-03-28 05:32:08 [auto1.de] INFO: Saving data for EL91919: {'auction_closing_time': 1774716098.0, 'created_time': 1774463670.153035, 'last_price_update_time': 1774675928.284651}
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL91919') HTTP/1.1" 204 0
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: ZR88631
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR88631%27 HTTP/1.1" 200 None
2026-03-28 05:32:08 [auto1.de] INFO: Scrape type for ZR88631: 0
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: AD17341
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD17341%27 HTTP/1.1" 200 None
2026-03-28 05:32:08 [auto1.de] INFO: Scrape type for AD17341: 0
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: DY66816
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: TS73841
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: ZR29667
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR29667%27 HTTP/1.1" 200 None
2026-03-28 05:32:08 [auto1.de] INFO: Scrape type for ZR29667: 0
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: PR18701
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: NZ20734
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: CR46932
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR46932%27 HTTP/1.1" 200 None
2026-03-28 05:32:08 [auto1.de] INFO: Scrape type for CR46932: 0
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: GD15410
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: SU75801
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU75801%27 HTTP/1.1" 200 None
2026-03-28 05:32:08 [auto1.de] INFO: Scrape type for SU75801: 0
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: HZ20849
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20849%27 HTTP/1.1" 200 None
2026-03-28 05:32:08 [auto1.de] INFO: Scrape type for HZ20849: 0
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: EV62209
2026-03-28 05:32:08 [auto1.de] INFO: Found listing with ID: TY59388
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY59388%27 HTTP/1.1" 200 None
2026-03-28 05:32:08 [auto1.de] INFO: Scrape type for TY59388: 0
2026-03-28 05:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:09 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:09 [auto1.de] INFO: Found listing with ID: LG76747
2026-03-28 05:32:09 [auto1.de] INFO: Found listing with ID: WL38814
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL38814%27 HTTP/1.1" 200 None
2026-03-28 05:32:09 [auto1.de] INFO: Scrape type for WL38814: 0
2026-03-28 05:32:09 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-28 05:32:09 [auto1.de] INFO: Found listing with ID: FR53329
2026-03-28 05:32:09 [auto1.de] INFO: Found listing with ID: TB85730
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB85730%27 HTTP/1.1" 200 None
2026-03-28 05:32:09 [auto1.de] INFO: Scrape type for TB85730: 0
2026-03-28 05:32:09 [auto1.de] INFO: Found listing with ID: UV62797
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV62797%27 HTTP/1.1" 200 None
2026-03-28 05:32:09 [auto1.de] INFO: Scrape type for UV62797: 0
2026-03-28 05:32:09 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-28 05:32:09 [auto1.de] INFO: Scrape type for UK70882: 2
2026-03-28 05:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with identifier: UK70882
2026-03-28 05:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with scrape type 2
2026-03-28 05:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with scrape type 2
2026-03-28 05:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d, identifier: UK70882
2026-03-28 05:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with identifier: UK70882
2026-03-28 05:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with identifier: UK70882
2026-03-28 05:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with identifier: UK70882 to the API
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:34:53Z',
 'fuel_type': 'petrol',
 'id': '5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK70882',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 57398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-07',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2020}
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-28 05:32:09 [auto1.de] INFO: Saving data for UK70882: {'auction_closing_time': 1774715693.0, 'created_time': 1774552437.423216, 'last_price_update_time': 1774675929.837722}
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK70882') HTTP/1.1" 204 0
2026-03-28 05:32:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:09 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-28 05:32:09 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-28 05:32:09 [auto1.de] INFO: Found listing with ID: KU48323
2026-03-28 05:32:09 [auto1.de] INFO: Found listing with ID: KY16497
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY16497%27 HTTP/1.1" 200 None
2026-03-28 05:32:09 [auto1.de] INFO: Scrape type for KY16497: 2
2026-03-28 05:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bed3ebc1-ed4e-551f-944a-269349479ee1 with identifier: KY16497
2026-03-28 05:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bed3ebc1-ed4e-551f-944a-269349479ee1 with scrape type 2
2026-03-28 05:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bed3ebc1-ed4e-551f-944a-269349479ee1 with scrape type 2
2026-03-28 05:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bed3ebc1-ed4e-551f-944a-269349479ee1, identifier: KY16497
2026-03-28 05:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bed3ebc1-ed4e-551f-944a-269349479ee1 with identifier: KY16497
2026-03-28 05:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bed3ebc1-ed4e-551f-944a-269349479ee1 with identifier: KY16497
2026-03-28 05:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bed3ebc1-ed4e-551f-944a-269349479ee1 with identifier: KY16497 to the API
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:11:35Z',
 'fuel_type': 'petrol',
 'id': 'bed3ebc1-ed4e-551f-944a-269349479ee1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY16497',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 143988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-13',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY16497%27 HTTP/1.1" 200 None
2026-03-28 05:32:10 [auto1.de] INFO: Saving data for KY16497: {'auction_closing_time': 1774714295.0, 'created_time': 1774552852.071547, 'last_price_update_time': 1774675930.365651}
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY16497') HTTP/1.1" 204 0
2026-03-28 05:32:10 [auto1.de] INFO: Found listing with ID: KG98578
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98578%27 HTTP/1.1" 200 None
2026-03-28 05:32:10 [auto1.de] INFO: Scrape type for KG98578: 0
2026-03-28 05:32:10 [auto1.de] INFO: Found listing with ID: GC23604
2026-03-28 05:32:10 [auto1.de] INFO: Found listing with ID: PY07477
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07477%27 HTTP/1.1" 200 None
2026-03-28 05:32:10 [auto1.de] INFO: Scrape type for PY07477: 0
2026-03-28 05:32:10 [auto1.de] INFO: Found listing with ID: LU02094
2026-03-28 05:32:10 [auto1.de] INFO: Found listing with ID: XH29629
2026-03-28 05:32:10 [auto1.de] INFO: Found listing with ID: YY96665
2026-03-28 05:32:10 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-28 05:32:10 [auto1.de] INFO: Scrape type for GJ62462: 2
2026-03-28 05:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f36a97-229a-5e8b-854a-f24bca1aeb86 with identifier: GJ62462
2026-03-28 05:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f36a97-229a-5e8b-854a-f24bca1aeb86 with scrape type 2
2026-03-28 05:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52f36a97-229a-5e8b-854a-f24bca1aeb86 with scrape type 2
2026-03-28 05:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52f36a97-229a-5e8b-854a-f24bca1aeb86, identifier: GJ62462
2026-03-28 05:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52f36a97-229a-5e8b-854a-f24bca1aeb86 with identifier: GJ62462
2026-03-28 05:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52f36a97-229a-5e8b-854a-f24bca1aeb86 with identifier: GJ62462
2026-03-28 05:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52f36a97-229a-5e8b-854a-f24bca1aeb86 with identifier: GJ62462 to the API
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:44:35Z',
 'fuel_type': 'petrol',
 'id': '52f36a97-229a-5e8b-854a-f24bca1aeb86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ62462',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 74704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-21',
 'seller_name': None,
 'title': 'Audi A6 55 TFSI Mild-Hybrid quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2019}
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-28 05:32:10 [auto1.de] INFO: Saving data for GJ62462: {'auction_closing_time': 1774716275.0, 'created_time': 1774552975.110339, 'last_price_update_time': 1774675930.82984}
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ62462') HTTP/1.1" 204 0
2026-03-28 05:32:10 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-28 05:32:10 [auto1.de] INFO: Scrape type for SC48990: 2
2026-03-28 05:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c8fb642-e744-51d4-8048-23e8fb274ac3 with identifier: SC48990
2026-03-28 05:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c8fb642-e744-51d4-8048-23e8fb274ac3 with scrape type 2
2026-03-28 05:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c8fb642-e744-51d4-8048-23e8fb274ac3 with scrape type 2
2026-03-28 05:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c8fb642-e744-51d4-8048-23e8fb274ac3, identifier: SC48990
2026-03-28 05:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c8fb642-e744-51d4-8048-23e8fb274ac3 with identifier: SC48990
2026-03-28 05:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c8fb642-e744-51d4-8048-23e8fb274ac3 with identifier: SC48990
2026-03-28 05:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c8fb642-e744-51d4-8048-23e8fb274ac3 with identifier: SC48990 to the API
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:35:53Z',
 'fuel_type': 'diesel',
 'id': '9c8fb642-e744-51d4-8048-23e8fb274ac3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC48990',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 248165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-26',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2015}
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-28 05:32:11 [auto1.de] INFO: Saving data for SC48990: {'auction_closing_time': 1774715753.0, 'created_time': 1774552291.941664, 'last_price_update_time': 1774675931.358828}
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC48990') HTTP/1.1" 204 0
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: LW43153
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: CZ59156
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ59156%27 HTTP/1.1" 200 None
2026-03-28 05:32:11 [auto1.de] INFO: Scrape type for CZ59156: 0
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: NG39570
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG39570%27 HTTP/1.1" 200 None
2026-03-28 05:32:11 [auto1.de] INFO: Scrape type for NG39570: 0
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: DE61416
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE61416%27 HTTP/1.1" 200 None
2026-03-28 05:32:11 [auto1.de] INFO: Scrape type for DE61416: 0
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-28 05:32:11 [auto1.de] INFO: Scrape type for WS48624: 2
2026-03-28 05:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624
2026-03-28 05:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f182aa22-66f8-548c-8487-91e34763c870 with scrape type 2
2026-03-28 05:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f182aa22-66f8-548c-8487-91e34763c870 with scrape type 2
2026-03-28 05:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f182aa22-66f8-548c-8487-91e34763c870, identifier: WS48624
2026-03-28 05:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624
2026-03-28 05:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624
2026-03-28 05:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624 to the API
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:53:51Z',
 'fuel_type': 'diesel',
 'id': 'f182aa22-66f8-548c-8487-91e34763c870',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS48624',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 337077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-30',
 'seller_name': None,
 'title': 'Fiat Scudo 1.6 JTDM 10 SX L1H1 90 Multijet',
 'transmission': 'manual',
 'trim': '10 SX L1H1 90 Multijet',
 'year': 2010}
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-28 05:32:11 [auto1.de] INFO: Saving data for WS48624: {'auction_closing_time': 1774716831.0, 'created_time': 1774553009.584312, 'last_price_update_time': 1774675931.852663}
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS48624') HTTP/1.1" 204 0
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: DA75370
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75370%27 HTTP/1.1" 200 None
2026-03-28 05:32:11 [auto1.de] INFO: Scrape type for DA75370: 0
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: TV36332
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: YS83554
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS83554%27 HTTP/1.1" 200 None
2026-03-28 05:32:11 [auto1.de] INFO: Scrape type for YS83554: 0
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: MU75641
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU75641%27 HTTP/1.1" 200 None
2026-03-28 05:32:11 [auto1.de] INFO: Scrape type for MU75641: 0
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: SD07128
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD07128%27 HTTP/1.1" 200 None
2026-03-28 05:32:11 [auto1.de] INFO: Scrape type for SD07128: 0
2026-03-28 05:32:11 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-28 05:32:11 [auto1.de] INFO: Scrape type for GF78107: 2
2026-03-28 05:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd2c3f83-a98c-504f-9377-71f2da0f6d0f with identifier: GF78107
2026-03-28 05:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd2c3f83-a98c-504f-9377-71f2da0f6d0f with scrape type 2
2026-03-28 05:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd2c3f83-a98c-504f-9377-71f2da0f6d0f with scrape type 2
2026-03-28 05:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd2c3f83-a98c-504f-9377-71f2da0f6d0f, identifier: GF78107
2026-03-28 05:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd2c3f83-a98c-504f-9377-71f2da0f6d0f with identifier: GF78107
2026-03-28 05:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd2c3f83-a98c-504f-9377-71f2da0f6d0f with identifier: GF78107
2026-03-28 05:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd2c3f83-a98c-504f-9377-71f2da0f6d0f with identifier: GF78107 to the API
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:44:56Z',
 'fuel_type': 'petrol',
 'id': 'fd2c3f83-a98c-504f-9377-71f2da0f6d0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF78107',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 74711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-29',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2013}
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-28 05:32:12 [auto1.de] INFO: Saving data for GF78107: {'auction_closing_time': 1774716296.0, 'created_time': 1774552678.255363, 'last_price_update_time': 1774675932.375602}
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF78107') HTTP/1.1" 204 0
2026-03-28 05:32:12 [auto1.de] INFO: Found listing with ID: MM98410
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM98410%27 HTTP/1.1" 200 None
2026-03-28 05:32:12 [auto1.de] INFO: Scrape type for MM98410: 0
2026-03-28 05:32:12 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-28 05:32:12 [auto1.de] INFO: Found listing with ID: FL49521
2026-03-28 05:32:12 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-28 05:32:12 [auto1.de] INFO: Scrape type for NT88605: 2
2026-03-28 05:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605
2026-03-28 05:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with scrape type 2
2026-03-28 05:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with scrape type 2
2026-03-28 05:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d58cd1d-270c-556e-ad38-8cc097ae2a30, identifier: NT88605
2026-03-28 05:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605
2026-03-28 05:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605
2026-03-28 05:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605 to the API
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:10:13Z',
 'fuel_type': 'petrol',
 'id': '2d58cd1d-270c-556e-ad38-8cc097ae2a30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT88605',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 70429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Sound',
 'transmission': 'automatic',
 'trim': 'Sound',
 'year': 2017}
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-28 05:32:12 [auto1.de] INFO: Saving data for NT88605: {'auction_closing_time': 1774714213.0, 'created_time': 1774552933.834744, 'last_price_update_time': 1774675932.939112}
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT88605') HTTP/1.1" 204 0
2026-03-28 05:32:12 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-28 05:32:12 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-28 05:32:12 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-28 05:32:12 [auto1.de] INFO: Found listing with ID: AC43981
2026-03-28 05:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:13 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: MC69787
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: CR20682
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: NS29449
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS29449%27 HTTP/1.1" 200 None
2026-03-28 05:32:13 [auto1.de] INFO: Scrape type for NS29449: 0
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-28 05:32:13 [auto1.de] INFO: Scrape type for ER86835: 0
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: AM83584
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT28488%27 HTTP/1.1" 200 None
2026-03-28 05:32:13 [auto1.de] INFO: Scrape type for AT28488: 0
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: WK50134
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK50134%27 HTTP/1.1" 200 None
2026-03-28 05:32:13 [auto1.de] INFO: Scrape type for WK50134: 2
2026-03-28 05:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with identifier: WK50134
2026-03-28 05:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with scrape type 2
2026-03-28 05:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with scrape type 2
2026-03-28 05:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bd9b01f-5878-5c9c-9067-39da8cdd3878, identifier: WK50134
2026-03-28 05:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with identifier: WK50134
2026-03-28 05:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with identifier: WK50134
2026-03-28 05:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bd9b01f-5878-5c9c-9067-39da8cdd3878 with identifier: WK50134 to the API
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:44:34Z',
 'fuel_type': 'diesel',
 'id': '2bd9b01f-5878-5c9c-9067-39da8cdd3878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK50134',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 369863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK50134%27 HTTP/1.1" 200 None
2026-03-28 05:32:13 [auto1.de] INFO: Saving data for WK50134: {'auction_closing_time': 1774716274.0, 'created_time': 1774463634.974161, 'last_price_update_time': 1774675933.570453}
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK50134') HTTP/1.1" 204 0
2026-03-28 05:32:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: VS58629
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-28 05:32:13 [auto1.de] INFO: Scrape type for SU06279: 0
2026-03-28 05:32:13 [auto1.de] INFO: Found listing with ID: WA59157
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA59157%27 HTTP/1.1" 200 None
2026-03-28 05:32:13 [auto1.de] INFO: Scrape type for WA59157: 2
2026-03-28 05:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51bf034e-f450-55b1-9015-196003f3c094 with identifier: WA59157
2026-03-28 05:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51bf034e-f450-55b1-9015-196003f3c094 with scrape type 2
2026-03-28 05:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51bf034e-f450-55b1-9015-196003f3c094 with scrape type 2
2026-03-28 05:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51bf034e-f450-55b1-9015-196003f3c094, identifier: WA59157
2026-03-28 05:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51bf034e-f450-55b1-9015-196003f3c094 with identifier: WA59157
2026-03-28 05:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51bf034e-f450-55b1-9015-196003f3c094 with identifier: WA59157
2026-03-28 05:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51bf034e-f450-55b1-9015-196003f3c094 with identifier: WA59157 to the API
2026-03-28 05:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:33:51Z',
 'fuel_type': 'petrol',
 'id': '51bf034e-f450-55b1-9015-196003f3c094',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA59157',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 81161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-06',
 'seller_name': None,
 'title': 'Audi S3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA59157%27 HTTP/1.1" 200 None
2026-03-28 05:32:14 [auto1.de] INFO: Saving data for WA59157: {'auction_closing_time': 1774715631.0, 'created_time': 1773514034.932911, 'last_price_update_time': 1774675934.132038}
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA59157') HTTP/1.1" 204 0
2026-03-28 05:32:14 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-28 05:32:14 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-28 05:32:14 [auto1.de] INFO: Scrape type for NY15812: 2
2026-03-28 05:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339f5dcd-75e7-52f2-a755-838c65e847cc with identifier: NY15812
2026-03-28 05:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339f5dcd-75e7-52f2-a755-838c65e847cc with scrape type 2
2026-03-28 05:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339f5dcd-75e7-52f2-a755-838c65e847cc with scrape type 2
2026-03-28 05:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339f5dcd-75e7-52f2-a755-838c65e847cc, identifier: NY15812
2026-03-28 05:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339f5dcd-75e7-52f2-a755-838c65e847cc with identifier: NY15812
2026-03-28 05:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339f5dcd-75e7-52f2-a755-838c65e847cc with identifier: NY15812
2026-03-28 05:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339f5dcd-75e7-52f2-a755-838c65e847cc with identifier: NY15812 to the API
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:19:30Z',
 'fuel_type': 'petrol',
 'id': '339f5dcd-75e7-52f2-a755-838c65e847cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY15812',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 44054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-21',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2019}
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-28 05:32:14 [auto1.de] INFO: Saving data for NY15812: {'auction_closing_time': 1774714770.0, 'created_time': 1774550659.691238, 'last_price_update_time': 1774675934.576514}
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY15812') HTTP/1.1" 204 0
2026-03-28 05:32:14 [auto1.de] INFO: Found listing with ID: TH25711
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH25711%27 HTTP/1.1" 200 None
2026-03-28 05:32:14 [auto1.de] INFO: Scrape type for TH25711: 0
2026-03-28 05:32:14 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-28 05:32:14 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-28 05:32:14 [auto1.de] INFO: Found listing with ID: TW04232
2026-03-28 05:32:14 [auto1.de] INFO: Found listing with ID: FV21228
2026-03-28 05:32:14 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-28 05:32:14 [auto1.de] INFO: Found listing with ID: LX91307
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX91307%27 HTTP/1.1" 200 None
2026-03-28 05:32:14 [auto1.de] INFO: Scrape type for LX91307: 0
2026-03-28 05:32:14 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-28 05:32:14 [auto1.de] INFO: Scrape type for ZU57618: 2
2026-03-28 05:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with identifier: ZU57618
2026-03-28 05:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with scrape type 2
2026-03-28 05:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with scrape type 2
2026-03-28 05:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80b95fbd-9462-5f77-8e64-abc37ab5ef73, identifier: ZU57618
2026-03-28 05:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with identifier: ZU57618
2026-03-28 05:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with identifier: ZU57618
2026-03-28 05:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with identifier: ZU57618 to the API
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:23:31Z',
 'fuel_type': 'petrol',
 'id': '80b95fbd-9462-5f77-8e64-abc37ab5ef73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU57618',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 14451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-28 05:32:15 [auto1.de] INFO: Saving data for ZU57618: {'auction_closing_time': 1774715011.0, 'created_time': 1774552742.904132, 'last_price_update_time': 1774675935.044941}
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU57618') HTTP/1.1" 204 0
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: FG34327
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: BJ20331
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: TX55902
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: RN76659
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN76659%27 HTTP/1.1" 200 None
2026-03-28 05:32:15 [auto1.de] INFO: Scrape type for RN76659: 0
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: TL28504
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL28504%27 HTTP/1.1" 200 None
2026-03-28 05:32:15 [auto1.de] INFO: Scrape type for TL28504: 0
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: WV72742
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: BP63027
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: NE71450
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE71450%27 HTTP/1.1" 200 None
2026-03-28 05:32:15 [auto1.de] INFO: Scrape type for NE71450: 0
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: JK54144
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK54144%27 HTTP/1.1" 200 None
2026-03-28 05:32:15 [auto1.de] INFO: Scrape type for JK54144: 0
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: LU41152
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU41152%27 HTTP/1.1" 200 None
2026-03-28 05:32:15 [auto1.de] INFO: Scrape type for LU41152: 0
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: AP94467
2026-03-28 05:32:15 [auto1.de] INFO: Found listing with ID: YL58691
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL58691%27 HTTP/1.1" 200 None
2026-03-28 05:32:15 [auto1.de] INFO: Scrape type for YL58691: 0
2026-03-28 05:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:16 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:16 [auto1.de] INFO: Found listing with ID: TW29404
2026-03-28 05:32:16 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-28 05:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-28 05:32:16 [auto1.de] INFO: Scrape type for BC27569: 2
2026-03-28 05:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with identifier: BC27569
2026-03-28 05:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with scrape type 2
2026-03-28 05:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with scrape type 2
2026-03-28 05:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae5e5d71-bd0f-5eec-a284-2e98ef7cd477, identifier: BC27569
2026-03-28 05:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with identifier: BC27569
2026-03-28 05:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with identifier: BC27569
2026-03-28 05:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with identifier: BC27569 to the API
2026-03-28 05:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:38:42Z',
 'fuel_type': 'diesel',
 'id': 'ae5e5d71-bd0f-5eec-a284-2e98ef7cd477',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC27569',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 232991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-29',
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 2.8 CRD Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2009}
2026-03-28 05:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-28 05:32:16 [auto1.de] INFO: Saving data for BC27569: {'auction_closing_time': 1774715922.0, 'created_time': 1774550541.073067, 'last_price_update_time': 1774675936.941368}
2026-03-28 05:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC27569') HTTP/1.1" 204 0
2026-03-28 05:32:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: HY08427
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY08427%27 HTTP/1.1" 200 None
2026-03-28 05:32:17 [auto1.de] INFO: Scrape type for HY08427: 0
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: AN50976
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN50976%27 HTTP/1.1" 200 None
2026-03-28 05:32:17 [auto1.de] INFO: Scrape type for AN50976: 0
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: ES83380
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: WR22975
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR22975%27 HTTP/1.1" 200 None
2026-03-28 05:32:17 [auto1.de] INFO: Scrape type for WR22975: 0
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: XB15869
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: SH65641
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH65641%27 HTTP/1.1" 200 None
2026-03-28 05:32:17 [auto1.de] INFO: Scrape type for SH65641: 0
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: AP13517
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ62660%27 HTTP/1.1" 200 None
2026-03-28 05:32:17 [auto1.de] INFO: Scrape type for UJ62660: 0
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-28 05:32:17 [auto1.de] INFO: Scrape type for HW53715: 0
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-28 05:32:17 [auto1.de] INFO: Scrape type for DX03120: 2
2026-03-28 05:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 390c59ab-f8be-5d4a-810e-c7a96e38366f with identifier: DX03120
2026-03-28 05:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 390c59ab-f8be-5d4a-810e-c7a96e38366f with scrape type 2
2026-03-28 05:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 390c59ab-f8be-5d4a-810e-c7a96e38366f with scrape type 2
2026-03-28 05:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 390c59ab-f8be-5d4a-810e-c7a96e38366f, identifier: DX03120
2026-03-28 05:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 390c59ab-f8be-5d4a-810e-c7a96e38366f with identifier: DX03120
2026-03-28 05:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 390c59ab-f8be-5d4a-810e-c7a96e38366f with identifier: DX03120
2026-03-28 05:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 390c59ab-f8be-5d4a-810e-c7a96e38366f with identifier: DX03120 to the API
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:32:38Z',
 'fuel_type': 'petrol',
 'id': '390c59ab-f8be-5d4a-810e-c7a96e38366f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX03120',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 184428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-14',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-28 05:32:17 [auto1.de] INFO: Saving data for DX03120: {'auction_closing_time': 1774715558.0, 'created_time': 1774589463.213987, 'last_price_update_time': 1774675937.601582}
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX03120') HTTP/1.1" 204 0
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-28 05:32:17 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-28 05:32:17 [auto1.de] INFO: Scrape type for BW33957: 2
2026-03-28 05:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cca2414d-82a0-5884-8b6a-2d8db4b67c79 with identifier: BW33957
2026-03-28 05:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cca2414d-82a0-5884-8b6a-2d8db4b67c79 with scrape type 2
2026-03-28 05:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cca2414d-82a0-5884-8b6a-2d8db4b67c79 with scrape type 2
2026-03-28 05:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cca2414d-82a0-5884-8b6a-2d8db4b67c79, identifier: BW33957
2026-03-28 05:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cca2414d-82a0-5884-8b6a-2d8db4b67c79 with identifier: BW33957
2026-03-28 05:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cca2414d-82a0-5884-8b6a-2d8db4b67c79 with identifier: BW33957
2026-03-28 05:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cca2414d-82a0-5884-8b6a-2d8db4b67c79 with identifier: BW33957 to the API
2026-03-28 05:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:33:02Z',
 'fuel_type': 'petrol',
 'id': 'cca2414d-82a0-5884-8b6a-2d8db4b67c79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW33957',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 118388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-12',
 'seller_name': None,
 'title': 'Opel Vectra 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2007}
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-28 05:32:18 [auto1.de] INFO: Saving data for BW33957: {'auction_closing_time': 1774715582.0, 'created_time': 1774552125.647715, 'last_price_update_time': 1774675938.179392}
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW33957') HTTP/1.1" 204 0
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: MK42970
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: UA59950
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59950%27 HTTP/1.1" 200 None
2026-03-28 05:32:18 [auto1.de] INFO: Scrape type for UA59950: 0
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-28 05:32:18 [auto1.de] INFO: Scrape type for CT75216: 0
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: DS83303
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: SR06825
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: GC30442
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30442%27 HTTP/1.1" 200 None
2026-03-28 05:32:18 [auto1.de] INFO: Scrape type for GC30442: 2
2026-03-28 05:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fa7f913-62a2-57b6-96ce-0c7bed863db9 with identifier: GC30442
2026-03-28 05:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fa7f913-62a2-57b6-96ce-0c7bed863db9 with scrape type 2
2026-03-28 05:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fa7f913-62a2-57b6-96ce-0c7bed863db9 with scrape type 2
2026-03-28 05:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fa7f913-62a2-57b6-96ce-0c7bed863db9, identifier: GC30442
2026-03-28 05:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fa7f913-62a2-57b6-96ce-0c7bed863db9 with identifier: GC30442
2026-03-28 05:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fa7f913-62a2-57b6-96ce-0c7bed863db9 with identifier: GC30442
2026-03-28 05:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fa7f913-62a2-57b6-96ce-0c7bed863db9 with identifier: GC30442 to the API
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:23Z',
 'fuel_type': 'petrol',
 'id': '1fa7f913-62a2-57b6-96ce-0c7bed863db9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC30442',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 50469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-14',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30442%27 HTTP/1.1" 200 None
2026-03-28 05:32:18 [auto1.de] INFO: Saving data for GC30442: {'auction_closing_time': 1774717043.0, 'created_time': 1773342634.889598, 'last_price_update_time': 1774675938.6767}
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC30442') HTTP/1.1" 204 0
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: VC88612
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: WX33301
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-28 05:32:18 [auto1.de] INFO: Scrape type for YD46257: 0
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-28 05:32:18 [auto1.de] INFO: Scrape type for XP10598: 0
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: FJ03790
2026-03-28 05:32:18 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-28 05:32:18 [auto1.de] INFO: Scrape type for ZU04688: 2
2026-03-28 05:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with identifier: ZU04688
2026-03-28 05:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with scrape type 2
2026-03-28 05:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with scrape type 2
2026-03-28 05:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73e34e44-5ce3-51f5-b98e-87d0f5614e77, identifier: ZU04688
2026-03-28 05:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with identifier: ZU04688
2026-03-28 05:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with identifier: ZU04688
2026-03-28 05:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with identifier: ZU04688 to the API
2026-03-28 05:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:37Z',
 'fuel_type': 'diesel',
 'id': '73e34e44-5ce3-51f5-b98e-87d0f5614e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU04688',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 191725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-05',
 'seller_name': None,
 'title': 'Toyota Avensis 1.6 D-4D Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2016}
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-28 05:32:19 [auto1.de] INFO: Saving data for ZU04688: {'auction_closing_time': 1774714717.0, 'created_time': 1774589439.68938, 'last_price_update_time': 1774675939.193082}
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU04688') HTTP/1.1" 204 0
2026-03-28 05:32:19 [auto1.de] INFO: Found listing with ID: HX25760
2026-03-28 05:32:19 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-28 05:32:19 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-28 05:32:19 [auto1.de] INFO: Scrape type for RP88862: 2
2026-03-28 05:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with identifier: RP88862
2026-03-28 05:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with scrape type 2
2026-03-28 05:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with scrape type 2
2026-03-28 05:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32, identifier: RP88862
2026-03-28 05:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with identifier: RP88862
2026-03-28 05:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with identifier: RP88862
2026-03-28 05:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with identifier: RP88862 to the API
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:39:52Z',
 'fuel_type': 'petrol',
 'id': 'ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP88862',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 109654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-26',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-28 05:32:19 [auto1.de] INFO: Saving data for RP88862: {'auction_closing_time': 1774715992.0, 'created_time': 1774550645.415424, 'last_price_update_time': 1774675939.728194}
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP88862') HTTP/1.1" 204 0
2026-03-28 05:32:19 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-28 05:32:19 [auto1.de] INFO: Scrape type for KG08192: 2
2026-03-28 05:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63bb6853-1dcc-551c-8055-faeebc070221 with identifier: KG08192
2026-03-28 05:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63bb6853-1dcc-551c-8055-faeebc070221 with scrape type 2
2026-03-28 05:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63bb6853-1dcc-551c-8055-faeebc070221 with scrape type 2
2026-03-28 05:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63bb6853-1dcc-551c-8055-faeebc070221, identifier: KG08192
2026-03-28 05:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63bb6853-1dcc-551c-8055-faeebc070221 with identifier: KG08192
2026-03-28 05:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63bb6853-1dcc-551c-8055-faeebc070221 with identifier: KG08192
2026-03-28 05:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63bb6853-1dcc-551c-8055-faeebc070221 with identifier: KG08192 to the API
2026-03-28 05:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:46:09Z',
 'fuel_type': 'petrol',
 'id': '63bb6853-1dcc-551c-8055-faeebc070221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG08192',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 57825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-10',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 EX',
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2007}
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-28 05:32:20 [auto1.de] INFO: Saving data for KG08192: {'auction_closing_time': 1774716369.0, 'created_time': 1774552779.14027, 'last_price_update_time': 1774675940.159158}
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG08192') HTTP/1.1" 204 0
2026-03-28 05:32:20 [auto1.de] INFO: Found listing with ID: VM73254
2026-03-28 05:32:20 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-28 05:32:20 [auto1.de] INFO: Found listing with ID: AN43216
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN43216%27 HTTP/1.1" 200 None
2026-03-28 05:32:20 [auto1.de] INFO: Scrape type for AN43216: 0
2026-03-28 05:32:20 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-28 05:32:20 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-28 05:32:20 [auto1.de] INFO: Scrape type for EU22008: 0
2026-03-28 05:32:20 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-28 05:32:20 [auto1.de] INFO: Scrape type for BX09216: 2
2026-03-28 05:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31996f20-732f-5493-bd18-996a678ef2f6 with identifier: BX09216
2026-03-28 05:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31996f20-732f-5493-bd18-996a678ef2f6 with scrape type 2
2026-03-28 05:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31996f20-732f-5493-bd18-996a678ef2f6 with scrape type 2
2026-03-28 05:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31996f20-732f-5493-bd18-996a678ef2f6, identifier: BX09216
2026-03-28 05:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31996f20-732f-5493-bd18-996a678ef2f6 with identifier: BX09216
2026-03-28 05:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31996f20-732f-5493-bd18-996a678ef2f6 with identifier: BX09216
2026-03-28 05:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31996f20-732f-5493-bd18-996a678ef2f6 with identifier: BX09216 to the API
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:35:58Z',
 'fuel_type': 'diesel',
 'id': '31996f20-732f-5493-bd18-996a678ef2f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX09216',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 99593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-04',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2014}
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-28 05:32:20 [auto1.de] INFO: Saving data for BX09216: {'auction_closing_time': 1774715758.0, 'created_time': 1773945063.159255, 'last_price_update_time': 1774675940.636681}
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX09216') HTTP/1.1" 204 0
2026-03-28 05:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:20 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:20 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-28 05:32:20 [auto1.de] INFO: Scrape type for VY02082: 2
2026-03-28 05:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with identifier: VY02082
2026-03-28 05:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with scrape type 2
2026-03-28 05:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with scrape type 2
2026-03-28 05:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e12bb97f-4f2a-5960-9a45-7fe8ef9d7949, identifier: VY02082
2026-03-28 05:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with identifier: VY02082
2026-03-28 05:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with identifier: VY02082
2026-03-28 05:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with identifier: VY02082 to the API
2026-03-28 05:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:02:32Z',
 'fuel_type': 'diesel',
 'id': 'e12bb97f-4f2a-5960-9a45-7fe8ef9d7949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY02082',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 131050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-24',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 You!',
 'transmission': 'manual',
 'trim': 'You!',
 'year': 2015}
2026-03-28 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-28 05:32:21 [auto1.de] INFO: Saving data for VY02082: {'auction_closing_time': 1774713752.0, 'created_time': 1774552595.081643, 'last_price_update_time': 1774675941.949299}
2026-03-28 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY02082') HTTP/1.1" 204 0
2026-03-28 05:32:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: ZD44688
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: UD17683
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: XD99934
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD99934%27 HTTP/1.1" 200 None
2026-03-28 05:32:22 [auto1.de] INFO: Scrape type for XD99934: 0
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: SD42859
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD42859%27 HTTP/1.1" 200 None
2026-03-28 05:32:22 [auto1.de] INFO: Scrape type for SD42859: 0
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: SH18397
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-28 05:32:22 [auto1.de] INFO: Scrape type for SB37681: 0
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: VT99201
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT99201%27 HTTP/1.1" 200 None
2026-03-28 05:32:22 [auto1.de] INFO: Scrape type for VT99201: 0
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: SR45801
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-28 05:32:22 [auto1.de] INFO: Scrape type for DW68578: 2
2026-03-28 05:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0664f5d-d639-5929-b66f-e0e17255f834 with identifier: DW68578
2026-03-28 05:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0664f5d-d639-5929-b66f-e0e17255f834 with scrape type 2
2026-03-28 05:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0664f5d-d639-5929-b66f-e0e17255f834 with scrape type 2
2026-03-28 05:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0664f5d-d639-5929-b66f-e0e17255f834, identifier: DW68578
2026-03-28 05:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0664f5d-d639-5929-b66f-e0e17255f834 with identifier: DW68578
2026-03-28 05:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0664f5d-d639-5929-b66f-e0e17255f834 with identifier: DW68578
2026-03-28 05:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0664f5d-d639-5929-b66f-e0e17255f834 with identifier: DW68578 to the API
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:26:48Z',
 'fuel_type': 'diesel',
 'id': 'b0664f5d-d639-5929-b66f-e0e17255f834',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW68578',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 130595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Match',
 'transmission': 'automatic',
 'trim': 'Match',
 'year': 2012}
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-28 05:32:22 [auto1.de] INFO: Saving data for DW68578: {'auction_closing_time': 1774715208.0, 'created_time': 1774551857.440397, 'last_price_update_time': 1774675942.685207}
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW68578') HTTP/1.1" 204 0
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ76786%27 HTTP/1.1" 200 None
2026-03-28 05:32:22 [auto1.de] INFO: Scrape type for XZ76786: 0
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: TS09948
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: CY08035
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: MP29574
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: KB34579
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-28 05:32:22 [auto1.de] INFO: Scrape type for BG86685: 0
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: PV96474
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: PS89246
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS89246%27 HTTP/1.1" 200 None
2026-03-28 05:32:22 [auto1.de] INFO: Scrape type for PS89246: 0
2026-03-28 05:32:22 [auto1.de] INFO: Found listing with ID: XD38705
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD38705%27 HTTP/1.1" 200 None
2026-03-28 05:32:22 [auto1.de] INFO: Scrape type for XD38705: 2
2026-03-28 05:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 659626be-4645-5087-9ab3-c7568a77e8db with identifier: XD38705
2026-03-28 05:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 659626be-4645-5087-9ab3-c7568a77e8db with scrape type 2
2026-03-28 05:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 659626be-4645-5087-9ab3-c7568a77e8db with scrape type 2
2026-03-28 05:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 659626be-4645-5087-9ab3-c7568a77e8db, identifier: XD38705
2026-03-28 05:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 659626be-4645-5087-9ab3-c7568a77e8db with identifier: XD38705
2026-03-28 05:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 659626be-4645-5087-9ab3-c7568a77e8db with identifier: XD38705
2026-03-28 05:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 659626be-4645-5087-9ab3-c7568a77e8db with identifier: XD38705 to the API
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-28T16:32:23Z',
 'fuel_type': 'petrol',
 'id': '659626be-4645-5087-9ab3-c7568a77e8db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD38705',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 83566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seller_name': None,
 'title': 'Renault Kadjar 1.3 TCe Bose Edition',
 'transmission': 'manual',
 'trim': 'Bose Edition',
 'year': 2019}
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD38705%27 HTTP/1.1" 200 None
2026-03-28 05:32:23 [auto1.de] INFO: Saving data for XD38705: {'auction_closing_time': 1774715543.0, 'created_time': 1773344038.116283, 'last_price_update_time': 1774675943.297698}
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD38705') HTTP/1.1" 204 0
2026-03-28 05:32:23 [auto1.de] INFO: Found listing with ID: FK56908
2026-03-28 05:32:23 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-28 05:32:23 [auto1.de] INFO: Found listing with ID: KC05152
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC05152%27 HTTP/1.1" 200 None
2026-03-28 05:32:23 [auto1.de] INFO: Scrape type for KC05152: 0
2026-03-28 05:32:23 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-28 05:32:23 [auto1.de] INFO: Scrape type for AK58988: 0
2026-03-28 05:32:23 [auto1.de] INFO: Found listing with ID: GH45156
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH45156%27 HTTP/1.1" 200 None
2026-03-28 05:32:23 [auto1.de] INFO: Scrape type for GH45156: 2
2026-03-28 05:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 282c2302-9f77-57da-9239-77b7766f57e0 with identifier: GH45156
2026-03-28 05:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 282c2302-9f77-57da-9239-77b7766f57e0 with scrape type 2
2026-03-28 05:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 282c2302-9f77-57da-9239-77b7766f57e0 with scrape type 2
2026-03-28 05:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 282c2302-9f77-57da-9239-77b7766f57e0, identifier: GH45156
2026-03-28 05:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 282c2302-9f77-57da-9239-77b7766f57e0 with identifier: GH45156
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 05:32:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 282c2302-9f77-57da-9239-77b7766f57e0 with identifier: GH45156
2026-03-28 05:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 282c2302-9f77-57da-9239-77b7766f57e0 with identifier: GH45156 to the API
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:22:14Z',
 'fuel_type': 'petrol',
 'id': '282c2302-9f77-57da-9239-77b7766f57e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH45156',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 118657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-11',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Ambition Plus Edition',
 'transmission': 'manual',
 'trim': 'Ambition Plus Edition',
 'year': 2010}
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH45156%27 HTTP/1.1" 200 None
2026-03-28 05:32:24 [auto1.de] INFO: Saving data for GH45156: {'auction_closing_time': 1774714934.0, 'created_time': 1773308326.147834, 'last_price_update_time': 1774675944.01734}
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH45156') HTTP/1.1" 204 0
2026-03-28 05:32:24 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-28 05:32:24 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-28 05:32:24 [auto1.de] INFO: Scrape type for YG83893: 2
2026-03-28 05:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b3064a5-0890-58f8-aef4-2e15a6982099 with identifier: YG83893
2026-03-28 05:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b3064a5-0890-58f8-aef4-2e15a6982099 with scrape type 2
2026-03-28 05:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b3064a5-0890-58f8-aef4-2e15a6982099 with scrape type 2
2026-03-28 05:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b3064a5-0890-58f8-aef4-2e15a6982099, identifier: YG83893
2026-03-28 05:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b3064a5-0890-58f8-aef4-2e15a6982099 with identifier: YG83893
2026-03-28 05:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b3064a5-0890-58f8-aef4-2e15a6982099 with identifier: YG83893
2026-03-28 05:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b3064a5-0890-58f8-aef4-2e15a6982099 with identifier: YG83893 to the API
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:38:29Z',
 'fuel_type': 'diesel',
 'id': '9b3064a5-0890-58f8-aef4-2e15a6982099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG83893',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 145818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-20',
 'seller_name': None,
 'title': 'Audi A6 Allroad 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2022}
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-28 05:32:24 [auto1.de] INFO: Saving data for YG83893: {'auction_closing_time': 1774715909.0, 'created_time': 1774552429.399255, 'last_price_update_time': 1774675944.463084}
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG83893') HTTP/1.1" 204 0
2026-03-28 05:32:24 [auto1.de] INFO: Found listing with ID: WG89224
2026-03-28 05:32:24 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-28 05:32:24 [auto1.de] INFO: Scrape type for WJ18132: 2
2026-03-28 05:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f0e326f-c07f-503c-b636-2248552ea00b with identifier: WJ18132
2026-03-28 05:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f0e326f-c07f-503c-b636-2248552ea00b with scrape type 2
2026-03-28 05:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f0e326f-c07f-503c-b636-2248552ea00b with scrape type 2
2026-03-28 05:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f0e326f-c07f-503c-b636-2248552ea00b, identifier: WJ18132
2026-03-28 05:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f0e326f-c07f-503c-b636-2248552ea00b with identifier: WJ18132
2026-03-28 05:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f0e326f-c07f-503c-b636-2248552ea00b with identifier: WJ18132
2026-03-28 05:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f0e326f-c07f-503c-b636-2248552ea00b with identifier: WJ18132 to the API
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-28T16:16:55Z',
 'fuel_type': 'diesel',
 'id': '5f0e326f-c07f-503c-b636-2248552ea00b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ18132',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 88376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-02',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 BiTDI RS 4x4',
 'transmission': 'automatic',
 'trim': 'RS 4x4',
 'year': 2020}
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-28 05:32:24 [auto1.de] INFO: Saving data for WJ18132: {'auction_closing_time': 1774714615.0, 'created_time': 1774552103.400103, 'last_price_update_time': 1774675944.921594}
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ18132') HTTP/1.1" 204 0
2026-03-28 05:32:24 [auto1.de] INFO: Found listing with ID: VJ14955
2026-03-28 05:32:24 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-28 05:32:24 [auto1.de] INFO: Scrape type for ST45837: 2
2026-03-28 05:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with identifier: ST45837
2026-03-28 05:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with scrape type 2
2026-03-28 05:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with scrape type 2
2026-03-28 05:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6, identifier: ST45837
2026-03-28 05:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with identifier: ST45837
2026-03-28 05:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with identifier: ST45837
2026-03-28 05:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with identifier: ST45837 to the API
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:07Z',
 'fuel_type': 'diesel',
 'id': '3d70d1ce-c01e-5b5e-9335-2e734d29e1c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST45837',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 63109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-15',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six FWD',
 'transmission': 'manual',
 'trim': 'Generation Six FWD',
 'year': 2020}
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-28 05:32:25 [auto1.de] INFO: Saving data for ST45837: {'auction_closing_time': 1774713607.0, 'created_time': 1774550634.504006, 'last_price_update_time': 1774675945.339949}
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST45837') HTTP/1.1" 204 0
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: YU65678
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU65678%27 HTTP/1.1" 200 None
2026-03-28 05:32:25 [auto1.de] INFO: Scrape type for YU65678: 0
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: JN35186
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: WG93037
2026-03-28 05:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:25 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: ZP00129
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP00129%27 HTTP/1.1" 200 None
2026-03-28 05:32:25 [auto1.de] INFO: Scrape type for ZP00129: 0
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: PZ57242
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: WP89589
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW74525%27 HTTP/1.1" 200 None
2026-03-28 05:32:25 [auto1.de] INFO: Scrape type for UW74525: 0
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: BW90089
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: CD78722
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: AD42447
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD42447%27 HTTP/1.1" 200 None
2026-03-28 05:32:25 [auto1.de] INFO: Scrape type for AD42447: 0
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: SA32858
2026-03-28 05:32:25 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-28 05:32:25 [auto1.de] INFO: Scrape type for CW19006: 2
2026-03-28 05:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae805118-25e4-512e-8425-dfd58de8f565 with identifier: CW19006
2026-03-28 05:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae805118-25e4-512e-8425-dfd58de8f565 with scrape type 2
2026-03-28 05:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae805118-25e4-512e-8425-dfd58de8f565 with scrape type 2
2026-03-28 05:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae805118-25e4-512e-8425-dfd58de8f565, identifier: CW19006
2026-03-28 05:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae805118-25e4-512e-8425-dfd58de8f565 with identifier: CW19006
2026-03-28 05:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae805118-25e4-512e-8425-dfd58de8f565 with identifier: CW19006
2026-03-28 05:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae805118-25e4-512e-8425-dfd58de8f565 with identifier: CW19006 to the API
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:25:25Z',
 'fuel_type': 'diesel',
 'id': 'ae805118-25e4-512e-8425-dfd58de8f565',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW19006',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 151693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-16',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2014}
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-28 05:32:26 [auto1.de] INFO: Saving data for CW19006: {'auction_closing_time': 1774715125.0, 'created_time': 1774552129.520538, 'last_price_update_time': 1774675946.078376}
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW19006') HTTP/1.1" 204 0
2026-03-28 05:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:26 [auto1.de] INFO: Found listing with ID: CP28896
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP28896%27 HTTP/1.1" 200 None
2026-03-28 05:32:26 [auto1.de] INFO: Scrape type for CP28896: 0
2026-03-28 05:32:26 [auto1.de] INFO: Found listing with ID: CS85382
2026-03-28 05:32:26 [auto1.de] INFO: Found listing with ID: NP57126
2026-03-28 05:32:26 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY66131%27 HTTP/1.1" 200 None
2026-03-28 05:32:26 [auto1.de] INFO: Scrape type for PY66131: 2
2026-03-28 05:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131
2026-03-28 05:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cceb328-bdf5-5998-9122-703414400433 with scrape type 2
2026-03-28 05:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cceb328-bdf5-5998-9122-703414400433 with scrape type 2
2026-03-28 05:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cceb328-bdf5-5998-9122-703414400433, identifier: PY66131
2026-03-28 05:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131
2026-03-28 05:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131
2026-03-28 05:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131 to the API
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:17:45Z',
 'fuel_type': 'petrol',
 'id': '3cceb328-bdf5-5998-9122-703414400433',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY66131',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 162837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY66131%27 HTTP/1.1" 200 None
2026-03-28 05:32:26 [auto1.de] INFO: Saving data for PY66131: {'auction_closing_time': 1774714665.0, 'created_time': 1773303026.616629, 'last_price_update_time': 1774675946.663697}
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY66131') HTTP/1.1" 204 0
2026-03-28 05:32:26 [auto1.de] INFO: Found listing with ID: CF83908
2026-03-28 05:32:26 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90225%27 HTTP/1.1" 200 None
2026-03-28 05:32:26 [auto1.de] INFO: Scrape type for LW90225: 2
2026-03-28 05:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225
2026-03-28 05:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4db9f3e6-28ca-5789-b94e-baa1365522f0 with scrape type 2
2026-03-28 05:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4db9f3e6-28ca-5789-b94e-baa1365522f0 with scrape type 2
2026-03-28 05:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4db9f3e6-28ca-5789-b94e-baa1365522f0, identifier: LW90225
2026-03-28 05:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225
2026-03-28 05:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225
2026-03-28 05:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225 to the API
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:40:54Z',
 'fuel_type': 'diesel',
 'id': '4db9f3e6-28ca-5789-b94e-baa1365522f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW90225',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 180483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-08',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90225%27 HTTP/1.1" 200 None
2026-03-28 05:32:27 [auto1.de] INFO: Saving data for LW90225: {'auction_closing_time': 1774716054.0, 'created_time': 1773230000.780706, 'last_price_update_time': 1774675947.097796}
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW90225') HTTP/1.1" 204 0
2026-03-28 05:32:27 [auto1.de] INFO: Found listing with ID: LS49752
2026-03-28 05:32:27 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-28 05:32:27 [auto1.de] INFO: Found listing with ID: XN63500
2026-03-28 05:32:27 [auto1.de] INFO: Found listing with ID: WD62968
2026-03-28 05:32:27 [auto1.de] INFO: Found listing with ID: SA60451
2026-03-28 05:32:27 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-28 05:32:27 [auto1.de] INFO: Scrape type for MY90175: 0
2026-03-28 05:32:27 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW76455%27 HTTP/1.1" 200 None
2026-03-28 05:32:27 [auto1.de] INFO: Scrape type for RW76455: 2
2026-03-28 05:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455
2026-03-28 05:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04c92a5f-7935-5023-b523-054134cd48cd with scrape type 2
2026-03-28 05:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04c92a5f-7935-5023-b523-054134cd48cd with scrape type 2
2026-03-28 05:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04c92a5f-7935-5023-b523-054134cd48cd, identifier: RW76455
2026-03-28 05:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455
2026-03-28 05:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455
2026-03-28 05:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455 to the API
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:50:17Z',
 'fuel_type': 'petrol',
 'id': '04c92a5f-7935-5023-b523-054134cd48cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW76455',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 131878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG T 4Matic',
 'transmission': 'automatic',
 'trim': 'T 4Matic',
 'year': 2017}
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW76455%27 HTTP/1.1" 200 None
2026-03-28 05:32:27 [auto1.de] INFO: Saving data for RW76455: {'auction_closing_time': 1774716617.0, 'created_time': 1773136603.936512, 'last_price_update_time': 1774675947.560632}
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW76455') HTTP/1.1" 204 0
2026-03-28 05:32:27 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-28 05:32:27 [auto1.de] INFO: Scrape type for BT97147: 2
2026-03-28 05:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bdfc631-9e77-5990-b593-060e40391d94 with identifier: BT97147
2026-03-28 05:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bdfc631-9e77-5990-b593-060e40391d94 with scrape type 2
2026-03-28 05:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bdfc631-9e77-5990-b593-060e40391d94 with scrape type 2
2026-03-28 05:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bdfc631-9e77-5990-b593-060e40391d94, identifier: BT97147
2026-03-28 05:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bdfc631-9e77-5990-b593-060e40391d94 with identifier: BT97147
2026-03-28 05:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bdfc631-9e77-5990-b593-060e40391d94 with identifier: BT97147
2026-03-28 05:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bdfc631-9e77-5990-b593-060e40391d94 with identifier: BT97147 to the API
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:42:48Z',
 'fuel_type': 'petrol',
 'id': '6bdfc631-9e77-5990-b593-060e40391d94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT97147',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 92211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Saving data for BT97147: {'auction_closing_time': 1774716168.0, 'created_time': 1774550351.53723, 'last_price_update_time': 1774675948.096533}
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT97147') HTTP/1.1" 204 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: EW58649
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: MS64258
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS64258%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for MS64258: 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for SV69696: 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: GZ76371
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: TP46996
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP46996%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for TP46996: 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for YS99143: 2
2026-03-28 05:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cee0cb12-ca0e-581d-807e-72a326aa6b4e with identifier: YS99143
2026-03-28 05:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cee0cb12-ca0e-581d-807e-72a326aa6b4e with scrape type 2
2026-03-28 05:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cee0cb12-ca0e-581d-807e-72a326aa6b4e with scrape type 2
2026-03-28 05:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cee0cb12-ca0e-581d-807e-72a326aa6b4e, identifier: YS99143
2026-03-28 05:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cee0cb12-ca0e-581d-807e-72a326aa6b4e with identifier: YS99143
2026-03-28 05:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cee0cb12-ca0e-581d-807e-72a326aa6b4e with identifier: YS99143
2026-03-28 05:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cee0cb12-ca0e-581d-807e-72a326aa6b4e with identifier: YS99143 to the API
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:31:21Z',
 'fuel_type': 'petrol',
 'id': 'cee0cb12-ca0e-581d-807e-72a326aa6b4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS99143',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 121242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-16',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Saving data for YS99143: {'auction_closing_time': 1774715481.0, 'created_time': 1774550714.253812, 'last_price_update_time': 1774675948.566571}
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS99143') HTTP/1.1" 204 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: AK23764
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK23764%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for AK23764: 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: NM87427
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: ST39834
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST39834%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for ST39834: 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for AD30182: 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: RF93551
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF93551%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for RF93551: 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for NW39371: 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: XV50693
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50693%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for XV50693: 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: DM54367
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM54367%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for DM54367: 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: WU48136
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU48136%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for WU48136: 0
2026-03-28 05:32:28 [auto1.de] INFO: Found listing with ID: PX20258
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX20258%27 HTTP/1.1" 200 None
2026-03-28 05:32:28 [auto1.de] INFO: Scrape type for PX20258: 0
2026-03-28 05:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:29 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:29 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-28 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-28 05:32:29 [auto1.de] INFO: Scrape type for UP80660: 2
2026-03-28 05:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660
2026-03-28 05:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cfd998f-1017-5859-88b0-899bfbf83397 with scrape type 2
2026-03-28 05:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cfd998f-1017-5859-88b0-899bfbf83397 with scrape type 2
2026-03-28 05:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cfd998f-1017-5859-88b0-899bfbf83397, identifier: UP80660
2026-03-28 05:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660
2026-03-28 05:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660
2026-03-28 05:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660 to the API
2026-03-28 05:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:59:21Z',
 'fuel_type': 'diesel',
 'id': '8cfd998f-1017-5859-88b0-899bfbf83397',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP80660',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 121243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-01',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Vision 4WD',
 'transmission': 'automatic',
 'trim': 'Vision 4WD',
 'year': 2019}
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-28 05:32:30 [auto1.de] INFO: Saving data for UP80660: {'auction_closing_time': 1774717161.0, 'created_time': 1774550538.583381, 'last_price_update_time': 1774675950.018497}
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP80660') HTTP/1.1" 204 0
2026-03-28 05:32:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:30 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-28 05:32:30 [auto1.de] INFO: Scrape type for RX04560: 2
2026-03-28 05:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50e5f97a-1b45-56f5-8740-af7ad89b547e with identifier: RX04560
2026-03-28 05:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50e5f97a-1b45-56f5-8740-af7ad89b547e with scrape type 2
2026-03-28 05:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50e5f97a-1b45-56f5-8740-af7ad89b547e with scrape type 2
2026-03-28 05:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50e5f97a-1b45-56f5-8740-af7ad89b547e, identifier: RX04560
2026-03-28 05:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50e5f97a-1b45-56f5-8740-af7ad89b547e with identifier: RX04560
2026-03-28 05:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50e5f97a-1b45-56f5-8740-af7ad89b547e with identifier: RX04560
2026-03-28 05:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50e5f97a-1b45-56f5-8740-af7ad89b547e with identifier: RX04560 to the API
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:32:36Z',
 'fuel_type': 'petrol',
 'id': '50e5f97a-1b45-56f5-8740-af7ad89b547e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX04560',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 104400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-15',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2021}
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-28 05:32:30 [auto1.de] INFO: Saving data for RX04560: {'auction_closing_time': 1774715556.0, 'created_time': 1774550129.741281, 'last_price_update_time': 1774675950.563987}
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX04560') HTTP/1.1" 204 0
2026-03-28 05:32:30 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-28 05:32:30 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-28 05:32:30 [auto1.de] INFO: Found listing with ID: RT19739
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT19739%27 HTTP/1.1" 200 None
2026-03-28 05:32:30 [auto1.de] INFO: Scrape type for RT19739: 0
2026-03-28 05:32:30 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-28 05:32:30 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-28 05:32:30 [auto1.de] INFO: Scrape type for PW82194: 2
2026-03-28 05:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8413472b-2b50-501b-9184-6130f7b9f8c5 with identifier: PW82194
2026-03-28 05:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8413472b-2b50-501b-9184-6130f7b9f8c5 with scrape type 2
2026-03-28 05:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8413472b-2b50-501b-9184-6130f7b9f8c5 with scrape type 2
2026-03-28 05:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8413472b-2b50-501b-9184-6130f7b9f8c5, identifier: PW82194
2026-03-28 05:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8413472b-2b50-501b-9184-6130f7b9f8c5 with identifier: PW82194
2026-03-28 05:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8413472b-2b50-501b-9184-6130f7b9f8c5 with identifier: PW82194
2026-03-28 05:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8413472b-2b50-501b-9184-6130f7b9f8c5 with identifier: PW82194 to the API
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-28T16:30:48Z',
 'fuel_type': 'petrol',
 'id': '8413472b-2b50-501b-9184-6130f7b9f8c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW82194',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 128436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-18',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B6 Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2020}
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-28 05:32:31 [auto1.de] INFO: Saving data for PW82194: {'auction_closing_time': 1774715448.0, 'created_time': 1774550675.680441, 'last_price_update_time': 1774675951.037314}
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW82194') HTTP/1.1" 204 0
2026-03-28 05:32:31 [auto1.de] INFO: Found listing with ID: CH35600
2026-03-28 05:32:31 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-28 05:32:31 [auto1.de] INFO: Scrape type for ZJ19484: 2
2026-03-28 05:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82564df-113d-5196-898e-1f321830c20c with identifier: ZJ19484
2026-03-28 05:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82564df-113d-5196-898e-1f321830c20c with scrape type 2
2026-03-28 05:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f82564df-113d-5196-898e-1f321830c20c with scrape type 2
2026-03-28 05:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f82564df-113d-5196-898e-1f321830c20c, identifier: ZJ19484
2026-03-28 05:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f82564df-113d-5196-898e-1f321830c20c with identifier: ZJ19484
2026-03-28 05:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f82564df-113d-5196-898e-1f321830c20c with identifier: ZJ19484
2026-03-28 05:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f82564df-113d-5196-898e-1f321830c20c with identifier: ZJ19484 to the API
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:44:22Z',
 'fuel_type': 'diesel',
 'id': 'f82564df-113d-5196-898e-1f321830c20c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ19484',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 157645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-22',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Energy L2H1 2,9t Expression',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Expression',
 'year': 2018}
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-28 05:32:31 [auto1.de] INFO: Saving data for ZJ19484: {'auction_closing_time': 1774716262.0, 'created_time': 1774553034.219747, 'last_price_update_time': 1774675951.968607}
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ19484') HTTP/1.1" 204 0
2026-03-28 05:32:31 [auto1.de] INFO: Found listing with ID: JP66680
2026-03-28 05:32:31 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-28 05:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-28 05:32:32 [auto1.de] INFO: Scrape type for YF63409: 0
2026-03-28 05:32:32 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-28 05:32:32 [auto1.de] INFO: Scrape type for FZ49091: 0
2026-03-28 05:32:32 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-28 05:32:32 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-28 05:32:32 [auto1.de] INFO: Scrape type for PV67596: 2
2026-03-28 05:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596
2026-03-28 05:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with scrape type 2
2026-03-28 05:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with scrape type 2
2026-03-28 05:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4, identifier: PV67596
2026-03-28 05:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596
2026-03-28 05:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596
2026-03-28 05:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596 to the API
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:55:58Z',
 'fuel_type': 'petrol',
 'id': 'a97bb929-ab7e-58d6-8ccc-be5d1c033dd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV67596',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 204429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-15',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-28 05:32:32 [auto1.de] INFO: Saving data for PV67596: {'auction_closing_time': 1774716958.0, 'created_time': 1773741417.150559, 'last_price_update_time': 1774675952.512582}
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV67596') HTTP/1.1" 204 0
2026-03-28 05:32:32 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-28 05:32:32 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-28 05:32:32 [auto1.de] INFO: Scrape type for DS47068: 0
2026-03-28 05:32:32 [auto1.de] INFO: Found listing with ID: EK02801
2026-03-28 05:32:32 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-28 05:32:32 [auto1.de] INFO: Scrape type for MD20057: 2
2026-03-28 05:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75d7647-c777-5bc1-94f4-a5f13995a7d6 with identifier: MD20057
2026-03-28 05:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75d7647-c777-5bc1-94f4-a5f13995a7d6 with scrape type 2
2026-03-28 05:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b75d7647-c777-5bc1-94f4-a5f13995a7d6 with scrape type 2
2026-03-28 05:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b75d7647-c777-5bc1-94f4-a5f13995a7d6, identifier: MD20057
2026-03-28 05:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b75d7647-c777-5bc1-94f4-a5f13995a7d6 with identifier: MD20057
2026-03-28 05:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b75d7647-c777-5bc1-94f4-a5f13995a7d6 with identifier: MD20057
2026-03-28 05:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b75d7647-c777-5bc1-94f4-a5f13995a7d6 with identifier: MD20057 to the API
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:30:05Z',
 'fuel_type': 'diesel',
 'id': 'b75d7647-c777-5bc1-94f4-a5f13995a7d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD20057',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 222180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-24',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-28 05:32:33 [auto1.de] INFO: Saving data for MD20057: {'auction_closing_time': 1774715405.0, 'created_time': 1774552149.76955, 'last_price_update_time': 1774675953.059786}
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD20057') HTTP/1.1" 204 0
2026-03-28 05:32:33 [auto1.de] INFO: Found listing with ID: DH11465
2026-03-28 05:32:33 [auto1.de] INFO: Found listing with ID: CA94630
2026-03-28 05:32:33 [auto1.de] INFO: Found listing with ID: RL76868
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL76868%27 HTTP/1.1" 200 None
2026-03-28 05:32:33 [auto1.de] INFO: Scrape type for RL76868: 0
2026-03-28 05:32:33 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-28 05:32:33 [auto1.de] INFO: Scrape type for VU50436: 0
2026-03-28 05:32:33 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-28 05:32:33 [auto1.de] INFO: Scrape type for PY88123: 2
2026-03-28 05:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a7da3a-773e-5548-aeb7-4c4050cec14c with identifier: PY88123
2026-03-28 05:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a7da3a-773e-5548-aeb7-4c4050cec14c with scrape type 2
2026-03-28 05:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87a7da3a-773e-5548-aeb7-4c4050cec14c with scrape type 2
2026-03-28 05:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87a7da3a-773e-5548-aeb7-4c4050cec14c, identifier: PY88123
2026-03-28 05:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87a7da3a-773e-5548-aeb7-4c4050cec14c with identifier: PY88123
2026-03-28 05:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87a7da3a-773e-5548-aeb7-4c4050cec14c with identifier: PY88123
2026-03-28 05:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87a7da3a-773e-5548-aeb7-4c4050cec14c with identifier: PY88123 to the API
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 227,
 'expiration_date': '2026-03-28T16:43:49Z',
 'fuel_type': 'petrol',
 'id': '87a7da3a-773e-5548-aeb7-4c4050cec14c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY88123',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 26500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-12',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2024}
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-28 05:32:33 [auto1.de] INFO: Saving data for PY88123: {'auction_closing_time': 1774716229.0, 'created_time': 1774552967.664915, 'last_price_update_time': 1774675953.503773}
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY88123') HTTP/1.1" 204 0
2026-03-28 05:32:33 [auto1.de] INFO: Found listing with ID: ED51510
2026-03-28 05:32:33 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-28 05:32:33 [auto1.de] INFO: Scrape type for UL19330: 2
2026-03-28 05:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03ed601f-4eea-5f9c-bb52-678231624924 with identifier: UL19330
2026-03-28 05:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03ed601f-4eea-5f9c-bb52-678231624924 with scrape type 2
2026-03-28 05:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03ed601f-4eea-5f9c-bb52-678231624924 with scrape type 2
2026-03-28 05:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03ed601f-4eea-5f9c-bb52-678231624924, identifier: UL19330
2026-03-28 05:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03ed601f-4eea-5f9c-bb52-678231624924 with identifier: UL19330
2026-03-28 05:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03ed601f-4eea-5f9c-bb52-678231624924 with identifier: UL19330
2026-03-28 05:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03ed601f-4eea-5f9c-bb52-678231624924 with identifier: UL19330 to the API
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:15:34Z',
 'fuel_type': 'petrol',
 'id': '03ed601f-4eea-5f9c-bb52-678231624924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL19330',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 117580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-22',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 Ocean',
 'transmission': 'manual',
 'trim': 'Ocean',
 'year': 2004}
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-28 05:32:33 [auto1.de] INFO: Saving data for UL19330: {'auction_closing_time': 1774714534.0, 'created_time': 1774551840.352429, 'last_price_update_time': 1774675953.944656}
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL19330') HTTP/1.1" 204 0
2026-03-28 05:32:34 [auto1.de] INFO: Found listing with ID: MA62044
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA62044%27 HTTP/1.1" 200 None
2026-03-28 05:32:34 [auto1.de] INFO: Scrape type for MA62044: 0
2026-03-28 05:32:34 [auto1.de] INFO: Found listing with ID: SU53309
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU53309%27 HTTP/1.1" 200 None
2026-03-28 05:32:34 [auto1.de] INFO: Scrape type for SU53309: 0
2026-03-28 05:32:34 [auto1.de] INFO: Found listing with ID: XE97830
2026-03-28 05:32:34 [auto1.de] INFO: Found listing with ID: CS95663
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS95663%27 HTTP/1.1" 200 None
2026-03-28 05:32:34 [auto1.de] INFO: Scrape type for CS95663: 2
2026-03-28 05:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b63f0eb-749e-5425-8ac4-475fe98e2398 with identifier: CS95663
2026-03-28 05:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b63f0eb-749e-5425-8ac4-475fe98e2398 with scrape type 2
2026-03-28 05:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b63f0eb-749e-5425-8ac4-475fe98e2398 with scrape type 2
2026-03-28 05:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b63f0eb-749e-5425-8ac4-475fe98e2398, identifier: CS95663
2026-03-28 05:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b63f0eb-749e-5425-8ac4-475fe98e2398 with identifier: CS95663
2026-03-28 05:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b63f0eb-749e-5425-8ac4-475fe98e2398 with identifier: CS95663
2026-03-28 05:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b63f0eb-749e-5425-8ac4-475fe98e2398 with identifier: CS95663 to the API
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:08:53Z',
 'fuel_type': 'petrol',
 'id': '0b63f0eb-749e-5425-8ac4-475fe98e2398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS95663',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 90341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Hyundai i40 2.0 GDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS95663%27 HTTP/1.1" 200 None
2026-03-28 05:32:34 [auto1.de] INFO: Saving data for CS95663: {'auction_closing_time': 1774714133.0, 'created_time': 1774463671.449238, 'last_price_update_time': 1774675954.529478}
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS95663') HTTP/1.1" 204 0
2026-03-28 05:32:34 [auto1.de] INFO: Found listing with ID: AJ19988
2026-03-28 05:32:34 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-28 05:32:34 [auto1.de] INFO: Found listing with ID: LT67236
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT67236%27 HTTP/1.1" 200 None
2026-03-28 05:32:34 [auto1.de] INFO: Scrape type for LT67236: 0
2026-03-28 05:32:34 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-28 05:32:34 [auto1.de] INFO: Scrape type for HW22525: 2
2026-03-28 05:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525
2026-03-28 05:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with scrape type 2
2026-03-28 05:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with scrape type 2
2026-03-28 05:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4, identifier: HW22525
2026-03-28 05:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525
2026-03-28 05:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525
2026-03-28 05:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525 to the API
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:59:02Z',
 'fuel_type': 'diesel',
 'id': '5a0f6238-c86e-58c2-b7a9-4cd9787872e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW22525',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 257059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2008}
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-28 05:32:34 [auto1.de] INFO: Saving data for HW22525: {'auction_closing_time': 1774717142.0, 'created_time': 1774550699.773191, 'last_price_update_time': 1774675954.98354}
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW22525') HTTP/1.1" 204 0
2026-03-28 05:32:34 [auto1.de] INFO: Found listing with ID: PP02879
2026-03-28 05:32:35 [auto1.de] INFO: Found listing with ID: HE75386
2026-03-28 05:32:35 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-28 05:32:35 [auto1.de] INFO: Scrape type for VZ19342: 2
2026-03-28 05:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b10cb638-6971-5881-9787-b4341c26b445 with identifier: VZ19342
2026-03-28 05:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b10cb638-6971-5881-9787-b4341c26b445 with scrape type 2
2026-03-28 05:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b10cb638-6971-5881-9787-b4341c26b445 with scrape type 2
2026-03-28 05:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b10cb638-6971-5881-9787-b4341c26b445, identifier: VZ19342
2026-03-28 05:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b10cb638-6971-5881-9787-b4341c26b445 with identifier: VZ19342
2026-03-28 05:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b10cb638-6971-5881-9787-b4341c26b445 with identifier: VZ19342
2026-03-28 05:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b10cb638-6971-5881-9787-b4341c26b445 with identifier: VZ19342 to the API
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:27:05Z',
 'fuel_type': 'hybrid',
 'id': 'b10cb638-6971-5881-9787-b4341c26b445',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ19342',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 21540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-02',
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Team D',
 'transmission': 'automatic',
 'trim': '2WD Team D',
 'year': 2023}
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-28 05:32:35 [auto1.de] INFO: Saving data for VZ19342: {'auction_closing_time': 1774715225.0, 'created_time': 1774552104.950086, 'last_price_update_time': 1774675955.421407}
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ19342') HTTP/1.1" 204 0
2026-03-28 05:32:35 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:35 [auto1.de] INFO: Found listing with ID: MK06365
2026-03-28 05:32:35 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-28 05:32:35 [auto1.de] INFO: Scrape type for DK10933: 2
2026-03-28 05:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2658b977-15be-5b07-8fe4-2e1d6f112459 with identifier: DK10933
2026-03-28 05:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2658b977-15be-5b07-8fe4-2e1d6f112459 with scrape type 2
2026-03-28 05:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2658b977-15be-5b07-8fe4-2e1d6f112459 with scrape type 2
2026-03-28 05:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2658b977-15be-5b07-8fe4-2e1d6f112459, identifier: DK10933
2026-03-28 05:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2658b977-15be-5b07-8fe4-2e1d6f112459 with identifier: DK10933
2026-03-28 05:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2658b977-15be-5b07-8fe4-2e1d6f112459 with identifier: DK10933
2026-03-28 05:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2658b977-15be-5b07-8fe4-2e1d6f112459 with identifier: DK10933 to the API
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 186,
 'expiration_date': '2026-03-28T16:11:19Z',
 'fuel_type': 'diesel',
 'id': '2658b977-15be-5b07-8fe4-2e1d6f112459',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK10933',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 25290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2024}
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-28 05:32:35 [auto1.de] INFO: Saving data for DK10933: {'auction_closing_time': 1774714279.0, 'created_time': 1774552339.585954, 'last_price_update_time': 1774675955.947506}
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK10933') HTTP/1.1" 204 0
2026-03-28 05:32:35 [auto1.de] INFO: Found listing with ID: HV42647
2026-03-28 05:32:35 [auto1.de] INFO: Found listing with ID: PA83352
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA83352%27 HTTP/1.1" 200 None
2026-03-28 05:32:35 [auto1.de] INFO: Scrape type for PA83352: 0
2026-03-28 05:32:35 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-28 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-28 05:32:36 [auto1.de] INFO: Scrape type for GM59339: 2
2026-03-28 05:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2245e0c8-3e64-53b3-8088-060e684973b8 with identifier: GM59339
2026-03-28 05:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2245e0c8-3e64-53b3-8088-060e684973b8 with scrape type 2
2026-03-28 05:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2245e0c8-3e64-53b3-8088-060e684973b8 with scrape type 2
2026-03-28 05:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2245e0c8-3e64-53b3-8088-060e684973b8, identifier: GM59339
2026-03-28 05:32:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-28 05:32:36 [auto1.de] INFO: Scrape type for NZ51315: 0
2026-03-28 05:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2245e0c8-3e64-53b3-8088-060e684973b8 with identifier: GM59339
2026-03-28 05:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2245e0c8-3e64-53b3-8088-060e684973b8 with identifier: GM59339
2026-03-28 05:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2245e0c8-3e64-53b3-8088-060e684973b8 with identifier: GM59339 to the API
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:25:07Z',
 'fuel_type': 'diesel',
 'id': '2245e0c8-3e64-53b3-8088-060e684973b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM59339',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 147134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-02',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-28 05:32:36 [auto1.de] INFO: Saving data for GM59339: {'auction_closing_time': 1774715107.0, 'created_time': 1774553021.213282, 'last_price_update_time': 1774675956.43959}
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM59339') HTTP/1.1" 204 0
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: WR71017
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: JG22521
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX59054%27 HTTP/1.1" 200 None
2026-03-28 05:32:36 [auto1.de] INFO: Scrape type for TX59054: 0
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: CS66629
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: TH58497
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: XV43778
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: PX36804
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX36804%27 HTTP/1.1" 200 None
2026-03-28 05:32:36 [auto1.de] INFO: Scrape type for PX36804: 0
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-28 05:32:36 [auto1.de] INFO: Scrape type for ZK07522: 0
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: PW66424
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW66424%27 HTTP/1.1" 200 None
2026-03-28 05:32:36 [auto1.de] INFO: Scrape type for PW66424: 0
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: VF30543
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF30543%27 HTTP/1.1" 200 None
2026-03-28 05:32:36 [auto1.de] INFO: Scrape type for VF30543: 0
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: LE20823
2026-03-28 05:32:36 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-28 05:32:36 [auto1.de] INFO: Scrape type for MF41784: 2
2026-03-28 05:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784
2026-03-28 05:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with scrape type 2
2026-03-28 05:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with scrape type 2
2026-03-28 05:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50, identifier: MF41784
2026-03-28 05:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784
2026-03-28 05:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784
2026-03-28 05:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784 to the API
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-28T16:57:58Z',
 'fuel_type': 'diesel',
 'id': '30a7f072-c5cb-5b4b-bb68-02bd8e8aca50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF41784',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 250128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-02',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Avantage',
 'transmission': 'manual',
 'trim': 'Avantage',
 'year': 2009}
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-28 05:32:36 [auto1.de] INFO: Saving data for MF41784: {'auction_closing_time': 1774717078.0, 'created_time': 1773946414.816105, 'last_price_update_time': 1774675956.949358}
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF41784') HTTP/1.1" 204 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for YR31209: 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: MM41381
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM41381%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for MM41381: 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: JD69912
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD69912%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for JD69912: 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: LB51000
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: DH10709
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH10709%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for DH10709: 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for PR50786: 2
2026-03-28 05:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with identifier: PR50786
2026-03-28 05:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with scrape type 2
2026-03-28 05:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with scrape type 2
2026-03-28 05:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f, identifier: PR50786
2026-03-28 05:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with identifier: PR50786
2026-03-28 05:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with identifier: PR50786
2026-03-28 05:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with identifier: PR50786 to the API
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:23:31Z',
 'fuel_type': 'petrol',
 'id': '700ce3f2-ebe7-57cd-a8a3-1274990e9a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR50786',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 48431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-09',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 FSI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2005}
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Saving data for PR50786: {'auction_closing_time': 1774715011.0, 'created_time': 1774552155.503366, 'last_price_update_time': 1774675957.545291}
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR50786') HTTP/1.1" 204 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for AM35234: 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: KF96616
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96616%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for KF96616: 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: EZ29207
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ29207%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for EZ29207: 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: AJ30359
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ30359%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for AJ30359: 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: TF26845
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: FR49421
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR49421%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for FR49421: 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: XE20875
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: HE95422
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: FL47412
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: KV09171
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV09171%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for KV09171: 0
2026-03-28 05:32:37 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-28 05:32:37 [auto1.de] INFO: Scrape type for VE03726: 2
2026-03-28 05:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726
2026-03-28 05:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5592bb11-65bc-56d7-90ee-c425543032ae with scrape type 2
2026-03-28 05:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5592bb11-65bc-56d7-90ee-c425543032ae with scrape type 2
2026-03-28 05:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5592bb11-65bc-56d7-90ee-c425543032ae, identifier: VE03726
2026-03-28 05:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726
2026-03-28 05:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726
2026-03-28 05:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726 to the API
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:56:42Z',
 'fuel_type': 'petrol',
 'id': '5592bb11-65bc-56d7-90ee-c425543032ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE03726',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 19108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-05-25',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2025}
2026-03-28 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-28 05:32:38 [auto1.de] INFO: Saving data for VE03726: {'auction_closing_time': 1774717002.0, 'created_time': 1773133077.958781, 'last_price_update_time': 1774675958.086626}
2026-03-28 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE03726') HTTP/1.1" 204 0
2026-03-28 05:32:38 [auto1.de] INFO: Found listing with ID: EC82787
2026-03-28 05:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:39 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:39 [auto1.de] INFO: Found listing with ID: RD70128
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD70128%27 HTTP/1.1" 200 None
2026-03-28 05:32:39 [auto1.de] INFO: Scrape type for RD70128: 2
2026-03-28 05:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ddc4f1c-43c5-5ec4-a28b-0e513d2c2242 with identifier: RD70128
2026-03-28 05:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ddc4f1c-43c5-5ec4-a28b-0e513d2c2242 with scrape type 2
2026-03-28 05:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ddc4f1c-43c5-5ec4-a28b-0e513d2c2242 with scrape type 2
2026-03-28 05:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ddc4f1c-43c5-5ec4-a28b-0e513d2c2242, identifier: RD70128
2026-03-28 05:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ddc4f1c-43c5-5ec4-a28b-0e513d2c2242 with identifier: RD70128
2026-03-28 05:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ddc4f1c-43c5-5ec4-a28b-0e513d2c2242 with identifier: RD70128
2026-03-28 05:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ddc4f1c-43c5-5ec4-a28b-0e513d2c2242 with identifier: RD70128 to the API
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:55:13Z',
 'fuel_type': 'diesel',
 'id': '6ddc4f1c-43c5-5ec4-a28b-0e513d2c2242',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD70128',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 52729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-26',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD70128%27 HTTP/1.1" 200 None
2026-03-28 05:32:39 [auto1.de] INFO: Saving data for RD70128: {'auction_closing_time': 1774716913.0, 'created_time': 1773660469.31778, 'last_price_update_time': 1774675959.744451}
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD70128') HTTP/1.1" 204 0
2026-03-28 05:32:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:39 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-28 05:32:39 [auto1.de] INFO: Scrape type for UC09176: 0
2026-03-28 05:32:39 [auto1.de] INFO: Found listing with ID: AN49564
2026-03-28 05:32:39 [auto1.de] INFO: Found listing with ID: SV38598
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV38598%27 HTTP/1.1" 200 None
2026-03-28 05:32:39 [auto1.de] INFO: Scrape type for SV38598: 2
2026-03-28 05:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with identifier: SV38598
2026-03-28 05:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with scrape type 2
2026-03-28 05:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with scrape type 2
2026-03-28 05:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f0124fa-26e5-5739-adbc-b2f46aacfd11, identifier: SV38598
2026-03-28 05:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with identifier: SV38598
2026-03-28 05:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with identifier: SV38598
2026-03-28 05:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f0124fa-26e5-5739-adbc-b2f46aacfd11 with identifier: SV38598 to the API
2026-03-28 05:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:12:25Z',
 'fuel_type': 'petrol',
 'id': '9f0124fa-26e5-5739-adbc-b2f46aacfd11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV38598',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 78086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'R BlueMotion 4Motion',
 'year': 2019}
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV38598%27 HTTP/1.1" 200 None
2026-03-28 05:32:40 [auto1.de] INFO: Saving data for SV38598: {'auction_closing_time': 1774714345.0, 'created_time': 1774463652.604497, 'last_price_update_time': 1774675960.2105}
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV38598') HTTP/1.1" 204 0
2026-03-28 05:32:40 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-28 05:32:40 [auto1.de] INFO: Scrape type for JM39243: 2
2026-03-28 05:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243
2026-03-28 05:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d008177-ccec-5e27-a287-4eb3f2095452 with scrape type 2
2026-03-28 05:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d008177-ccec-5e27-a287-4eb3f2095452 with scrape type 2
2026-03-28 05:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d008177-ccec-5e27-a287-4eb3f2095452, identifier: JM39243
2026-03-28 05:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243
2026-03-28 05:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243
2026-03-28 05:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243 to the API
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:53:27Z',
 'fuel_type': 'diesel',
 'id': '6d008177-ccec-5e27-a287-4eb3f2095452',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM39243',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 279140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-10',
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-28 05:32:40 [auto1.de] INFO: Saving data for JM39243: {'auction_closing_time': 1774716807.0, 'created_time': 1774589461.054211, 'last_price_update_time': 1774675960.650863}
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM39243') HTTP/1.1" 204 0
2026-03-28 05:32:40 [auto1.de] INFO: Found listing with ID: XJ09015
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ09015%27 HTTP/1.1" 200 None
2026-03-28 05:32:40 [auto1.de] INFO: Scrape type for XJ09015: 2
2026-03-28 05:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb8e1740-66b0-524e-a883-ec853c52a4a0 with identifier: XJ09015
2026-03-28 05:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb8e1740-66b0-524e-a883-ec853c52a4a0 with scrape type 2
2026-03-28 05:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb8e1740-66b0-524e-a883-ec853c52a4a0 with scrape type 2
2026-03-28 05:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb8e1740-66b0-524e-a883-ec853c52a4a0, identifier: XJ09015
2026-03-28 05:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb8e1740-66b0-524e-a883-ec853c52a4a0 with identifier: XJ09015
2026-03-28 05:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb8e1740-66b0-524e-a883-ec853c52a4a0 with identifier: XJ09015
2026-03-28 05:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb8e1740-66b0-524e-a883-ec853c52a4a0 with identifier: XJ09015 to the API
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:38:55Z',
 'fuel_type': 'petrol',
 'id': 'cb8e1740-66b0-524e-a883-ec853c52a4a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ09015',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 143414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-28',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2010}
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ09015%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Saving data for XJ09015: {'auction_closing_time': 1774715935.0, 'created_time': 1774552314.240797, 'last_price_update_time': 1774675961.081075}
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ09015') HTTP/1.1" 204 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for JY20186: 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: ZC73277
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: FL25481
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for SR33990: 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: ZC73485
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC73485%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for ZC73485: 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: HZ37968
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ37968%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for HZ37968: 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: AB21758
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB21758%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for AB21758: 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: EX42379
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX42379%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for EX42379: 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: MN42174
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42174%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for MN42174: 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: VR15853
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: UY94864
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: AP00177
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: AV59132
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV59132%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for AV59132: 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: WN98613
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: MS42171
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: GS07550
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: WU35652
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for JY24308: 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: NT94381
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT94381%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for NT94381: 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for UV59464: 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for XF58855: 2
2026-03-28 05:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with identifier: XF58855
2026-03-28 05:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with scrape type 2
2026-03-28 05:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with scrape type 2
2026-03-28 05:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b, identifier: XF58855
2026-03-28 05:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with identifier: XF58855
2026-03-28 05:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with identifier: XF58855
2026-03-28 05:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with identifier: XF58855 to the API
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:23:06Z',
 'fuel_type': 'petrol',
 'id': '9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF58855',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Tiida',
 'odometer': 240110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Nissan Tiida 1.6 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2010}
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Saving data for XF58855: {'auction_closing_time': 1774714986.0, 'created_time': 1774552924.513874, 'last_price_update_time': 1774675961.716658}
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF58855') HTTP/1.1" 204 0
2026-03-28 05:32:41 [auto1.de] INFO: Found listing with ID: CK72775
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72775%27 HTTP/1.1" 200 None
2026-03-28 05:32:41 [auto1.de] INFO: Scrape type for CK72775: 2
2026-03-28 05:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3523be4d-0b49-5059-8284-3ecd0d9cd7c1 with identifier: CK72775
2026-03-28 05:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3523be4d-0b49-5059-8284-3ecd0d9cd7c1 with scrape type 2
2026-03-28 05:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3523be4d-0b49-5059-8284-3ecd0d9cd7c1 with scrape type 2
2026-03-28 05:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3523be4d-0b49-5059-8284-3ecd0d9cd7c1, identifier: CK72775
2026-03-28 05:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3523be4d-0b49-5059-8284-3ecd0d9cd7c1 with identifier: CK72775
2026-03-28 05:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3523be4d-0b49-5059-8284-3ecd0d9cd7c1 with identifier: CK72775
2026-03-28 05:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3523be4d-0b49-5059-8284-3ecd0d9cd7c1 with identifier: CK72775 to the API
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:24:45Z',
 'fuel_type': 'petrol',
 'id': '3523be4d-0b49-5059-8284-3ecd0d9cd7c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK72775',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 163660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-03',
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72775%27 HTTP/1.1" 200 None
2026-03-28 05:32:42 [auto1.de] INFO: Saving data for CK72775: {'auction_closing_time': 1774715085.0, 'created_time': 1773860815.486405, 'last_price_update_time': 1774675962.255165}
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK72775') HTTP/1.1" 204 0
2026-03-28 05:32:42 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH65688%27 HTTP/1.1" 200 None
2026-03-28 05:32:42 [auto1.de] INFO: Scrape type for PH65688: 0
2026-03-28 05:32:42 [auto1.de] INFO: Found listing with ID: YN98514
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN98514%27 HTTP/1.1" 200 None
2026-03-28 05:32:42 [auto1.de] INFO: Scrape type for YN98514: 2
2026-03-28 05:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24b2ff0-2b9f-5a4a-9d75-c34e72da7a5e with identifier: YN98514
2026-03-28 05:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24b2ff0-2b9f-5a4a-9d75-c34e72da7a5e with scrape type 2
2026-03-28 05:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c24b2ff0-2b9f-5a4a-9d75-c34e72da7a5e with scrape type 2
2026-03-28 05:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c24b2ff0-2b9f-5a4a-9d75-c34e72da7a5e, identifier: YN98514
2026-03-28 05:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c24b2ff0-2b9f-5a4a-9d75-c34e72da7a5e with identifier: YN98514
2026-03-28 05:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c24b2ff0-2b9f-5a4a-9d75-c34e72da7a5e with identifier: YN98514
2026-03-28 05:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c24b2ff0-2b9f-5a4a-9d75-c34e72da7a5e with identifier: YN98514 to the API
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:49Z',
 'fuel_type': 'petrol',
 'id': 'c24b2ff0-2b9f-5a4a-9d75-c34e72da7a5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN98514',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 81265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-24',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2019}
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN98514%27 HTTP/1.1" 200 None
2026-03-28 05:32:42 [auto1.de] INFO: Saving data for YN98514: {'auction_closing_time': 1774716529.0, 'created_time': 1774553005.936871, 'last_price_update_time': 1774675962.690146}
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN98514') HTTP/1.1" 204 0
2026-03-28 05:32:42 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-28 05:32:42 [auto1.de] INFO: Scrape type for AM78577: 2
2026-03-28 05:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577
2026-03-28 05:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5941aaef-ac49-547c-9e29-fa0d744649d0 with scrape type 2
2026-03-28 05:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5941aaef-ac49-547c-9e29-fa0d744649d0 with scrape type 2
2026-03-28 05:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5941aaef-ac49-547c-9e29-fa0d744649d0, identifier: AM78577
2026-03-28 05:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577
2026-03-28 05:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577
2026-03-28 05:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577 to the API
2026-03-28 05:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:52Z',
 'fuel_type': 'diesel',
 'id': '5941aaef-ac49-547c-9e29-fa0d744649d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM78577',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 218664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-28',
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Evalia Tekna',
 'transmission': 'manual',
 'trim': 'Evalia Tekna',
 'year': 2014}
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-28 05:32:43 [auto1.de] INFO: Saving data for AM78577: {'auction_closing_time': 1774716652.0, 'created_time': 1774551452.446005, 'last_price_update_time': 1774675963.138741}
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM78577') HTTP/1.1" 204 0
2026-03-28 05:32:43 [auto1.de] INFO: Found listing with ID: AZ27432
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ27432%27 HTTP/1.1" 200 None
2026-03-28 05:32:43 [auto1.de] INFO: Scrape type for AZ27432: 0
2026-03-28 05:32:43 [auto1.de] INFO: Found listing with ID: FZ54460
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ54460%27 HTTP/1.1" 200 None
2026-03-28 05:32:43 [auto1.de] INFO: Scrape type for FZ54460: 0
2026-03-28 05:32:43 [auto1.de] INFO: Found listing with ID: KK55590
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK55590%27 HTTP/1.1" 200 None
2026-03-28 05:32:43 [auto1.de] INFO: Scrape type for KK55590: 0
2026-03-28 05:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:43 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:43 [auto1.de] INFO: Found listing with ID: NC47913
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC47913%27 HTTP/1.1" 200 None
2026-03-28 05:32:43 [auto1.de] INFO: Scrape type for NC47913: 0
2026-03-28 05:32:43 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ25562%27 HTTP/1.1" 200 None
2026-03-28 05:32:43 [auto1.de] INFO: Scrape type for JZ25562: 0
2026-03-28 05:32:43 [auto1.de] INFO: Found listing with ID: KD46198
2026-03-28 05:32:43 [auto1.de] INFO: Found listing with ID: FC08101
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC08101%27 HTTP/1.1" 200 None
2026-03-28 05:32:43 [auto1.de] INFO: Scrape type for FC08101: 0
2026-03-28 05:32:43 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-28 05:32:43 [auto1.de] INFO: Scrape type for DN96798: 2
2026-03-28 05:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09abb2f7-841d-5eb6-a34f-d66988aba860 with identifier: DN96798
2026-03-28 05:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09abb2f7-841d-5eb6-a34f-d66988aba860 with scrape type 2
2026-03-28 05:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09abb2f7-841d-5eb6-a34f-d66988aba860 with scrape type 2
2026-03-28 05:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09abb2f7-841d-5eb6-a34f-d66988aba860, identifier: DN96798
2026-03-28 05:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09abb2f7-841d-5eb6-a34f-d66988aba860 with identifier: DN96798
2026-03-28 05:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09abb2f7-841d-5eb6-a34f-d66988aba860 with identifier: DN96798
2026-03-28 05:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09abb2f7-841d-5eb6-a34f-d66988aba860 with identifier: DN96798 to the API
2026-03-28 05:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:23:08Z',
 'fuel_type': 'diesel',
 'id': '09abb2f7-841d-5eb6-a34f-d66988aba860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN96798',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 103579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-28 05:32:44 [auto1.de] INFO: Saving data for DN96798: {'auction_closing_time': 1774714988.0, 'created_time': 1773916241.605163, 'last_price_update_time': 1774675964.131121}
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN96798') HTTP/1.1" 204 0
2026-03-28 05:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: BM71069
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: CK18909
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK18909%27 HTTP/1.1" 200 None
2026-03-28 05:32:44 [auto1.de] INFO: Scrape type for CK18909: 0
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-28 05:32:44 [auto1.de] INFO: Scrape type for FP35448: 2
2026-03-28 05:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with identifier: FP35448
2026-03-28 05:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with scrape type 2
2026-03-28 05:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with scrape type 2
2026-03-28 05:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b0ba1c3-dd15-549d-9c11-22a14df51f7e, identifier: FP35448
2026-03-28 05:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with identifier: FP35448
2026-03-28 05:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with identifier: FP35448
2026-03-28 05:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with identifier: FP35448 to the API
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:30:39Z',
 'fuel_type': 'diesel',
 'id': '6b0ba1c3-dd15-549d-9c11-22a14df51f7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP35448',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 292528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-13',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI clean diesel Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-28 05:32:44 [auto1.de] INFO: Saving data for FP35448: {'auction_closing_time': 1774715439.0, 'created_time': 1774552980.493874, 'last_price_update_time': 1774675964.667458}
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP35448') HTTP/1.1" 204 0
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: WW83643
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW83643%27 HTTP/1.1" 200 None
2026-03-28 05:32:44 [auto1.de] INFO: Scrape type for WW83643: 0
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: FU32442
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU32442%27 HTTP/1.1" 200 None
2026-03-28 05:32:44 [auto1.de] INFO: Scrape type for FU32442: 0
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: HP04846
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP04846%27 HTTP/1.1" 200 None
2026-03-28 05:32:44 [auto1.de] INFO: Scrape type for HP04846: 0
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: MP71247
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: SA48353
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA48353%27 HTTP/1.1" 200 None
2026-03-28 05:32:44 [auto1.de] INFO: Scrape type for SA48353: 0
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: ET75266
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET75266%27 HTTP/1.1" 200 None
2026-03-28 05:32:44 [auto1.de] INFO: Scrape type for ET75266: 0
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: YX64853
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX64853%27 HTTP/1.1" 200 None
2026-03-28 05:32:44 [auto1.de] INFO: Scrape type for YX64853: 0
2026-03-28 05:32:44 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-28 05:32:44 [auto1.de] INFO: Scrape type for XL73598: 2
2026-03-28 05:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe047ad-52b8-51ec-88f5-94a0046d016a with identifier: XL73598
2026-03-28 05:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe047ad-52b8-51ec-88f5-94a0046d016a with scrape type 2
2026-03-28 05:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe047ad-52b8-51ec-88f5-94a0046d016a with scrape type 2
2026-03-28 05:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fe047ad-52b8-51ec-88f5-94a0046d016a, identifier: XL73598
2026-03-28 05:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fe047ad-52b8-51ec-88f5-94a0046d016a with identifier: XL73598
2026-03-28 05:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fe047ad-52b8-51ec-88f5-94a0046d016a with identifier: XL73598
2026-03-28 05:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fe047ad-52b8-51ec-88f5-94a0046d016a with identifier: XL73598 to the API
2026-03-28 05:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-28T16:33:11Z',
 'fuel_type': 'petrol',
 'id': '5fe047ad-52b8-51ec-88f5-94a0046d016a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL73598',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 138244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-16',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T6 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2019}
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Saving data for XL73598: {'auction_closing_time': 1774715591.0, 'created_time': 1773946268.452074, 'last_price_update_time': 1774675965.209521}
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL73598') HTTP/1.1" 204 0
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: TS72437
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: KB41878
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: NB19149
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB19149%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Scrape type for NB19149: 0
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: NM18841
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM18841%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Scrape type for NM18841: 0
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: BA95862
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: XF39485
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: FH78199
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH78199%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Scrape type for FH78199: 0
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: NG85198
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG85198%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Scrape type for NG85198: 0
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: ZC45709
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC45709%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Scrape type for ZC45709: 0
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Scrape type for LM64010: 2
2026-03-28 05:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340a8418-b555-5731-a0a4-fc225a827e29 with identifier: LM64010
2026-03-28 05:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340a8418-b555-5731-a0a4-fc225a827e29 with scrape type 2
2026-03-28 05:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 340a8418-b555-5731-a0a4-fc225a827e29 with scrape type 2
2026-03-28 05:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 340a8418-b555-5731-a0a4-fc225a827e29, identifier: LM64010
2026-03-28 05:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 340a8418-b555-5731-a0a4-fc225a827e29 with identifier: LM64010
2026-03-28 05:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 340a8418-b555-5731-a0a4-fc225a827e29 with identifier: LM64010
2026-03-28 05:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 340a8418-b555-5731-a0a4-fc225a827e29 with identifier: LM64010 to the API
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:36:39Z',
 'fuel_type': 'petrol',
 'id': '340a8418-b555-5731-a0a4-fc225a827e29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM64010',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'IS-Serie',
 'odometer': 221497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-28',
 'seller_name': None,
 'title': 'Lexus IS-Serie IS 200 Sport Cross',
 'transmission': 'manual',
 'trim': 'Sport Cross',
 'year': 2004}
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Saving data for LM64010: {'auction_closing_time': 1774715799.0, 'created_time': 1774550078.714764, 'last_price_update_time': 1774675965.812944}
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM64010') HTTP/1.1" 204 0
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: ZL42149
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL42149%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Scrape type for ZL42149: 0
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: AB54193
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB54193%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Scrape type for AB54193: 0
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: AN39214
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN39214%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Scrape type for AN39214: 0
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-28 05:32:45 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-28 05:32:45 [auto1.de] INFO: Scrape type for UA60360: 2
2026-03-28 05:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f030181-8011-507a-b598-f751118fcc3f with identifier: UA60360
2026-03-28 05:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f030181-8011-507a-b598-f751118fcc3f with scrape type 2
2026-03-28 05:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f030181-8011-507a-b598-f751118fcc3f with scrape type 2
2026-03-28 05:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f030181-8011-507a-b598-f751118fcc3f, identifier: UA60360
2026-03-28 05:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f030181-8011-507a-b598-f751118fcc3f with identifier: UA60360
2026-03-28 05:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f030181-8011-507a-b598-f751118fcc3f with identifier: UA60360
2026-03-28 05:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f030181-8011-507a-b598-f751118fcc3f with identifier: UA60360 to the API
2026-03-28 05:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:40:32Z',
 'fuel_type': 'diesel',
 'id': '6f030181-8011-507a-b598-f751118fcc3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA60360',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 328788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-09',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-28 05:32:46 [auto1.de] INFO: Saving data for UA60360: {'auction_closing_time': 1774716032.0, 'created_time': 1774551666.89731, 'last_price_update_time': 1774675966.434443}
2026-03-28 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA60360') HTTP/1.1" 204 0
2026-03-28 05:32:46 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-28 05:32:46 [auto1.de] INFO: Found listing with ID: LW16241
2026-03-28 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW16241%27 HTTP/1.1" 200 None
2026-03-28 05:32:46 [auto1.de] INFO: Scrape type for LW16241: 0
2026-03-28 05:32:46 [auto1.de] INFO: Found listing with ID: HZ35623
2026-03-28 05:32:46 [auto1.de] INFO: Found listing with ID: AV36949
2026-03-28 05:32:46 [auto1.de] INFO: Found listing with ID: HE50023
2026-03-28 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE50023%27 HTTP/1.1" 200 None
2026-03-28 05:32:46 [auto1.de] INFO: Scrape type for HE50023: 0
2026-03-28 05:32:46 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-28 05:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:47 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:47 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-28 05:32:47 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-28 05:32:47 [auto1.de] INFO: Found listing with ID: ML58643
2026-03-28 05:32:47 [auto1.de] INFO: Found listing with ID: XU25249
2026-03-28 05:32:47 [auto1.de] INFO: Found listing with ID: NF91521
2026-03-28 05:32:47 [auto1.de] INFO: Found listing with ID: WD57497
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD57497%27 HTTP/1.1" 200 None
2026-03-28 05:32:47 [auto1.de] INFO: Scrape type for WD57497: 0
2026-03-28 05:32:47 [auto1.de] INFO: Found listing with ID: VR97346
2026-03-28 05:32:47 [auto1.de] INFO: Found listing with ID: NZ77836
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ77836%27 HTTP/1.1" 200 None
2026-03-28 05:32:47 [auto1.de] INFO: Scrape type for NZ77836: 2
2026-03-28 05:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb8928e6-2aa1-56d6-ae0b-3dddf52310aa with identifier: NZ77836
2026-03-28 05:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb8928e6-2aa1-56d6-ae0b-3dddf52310aa with scrape type 2
2026-03-28 05:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb8928e6-2aa1-56d6-ae0b-3dddf52310aa with scrape type 2
2026-03-28 05:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb8928e6-2aa1-56d6-ae0b-3dddf52310aa, identifier: NZ77836
2026-03-28 05:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb8928e6-2aa1-56d6-ae0b-3dddf52310aa with identifier: NZ77836
2026-03-28 05:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb8928e6-2aa1-56d6-ae0b-3dddf52310aa with identifier: NZ77836
2026-03-28 05:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb8928e6-2aa1-56d6-ae0b-3dddf52310aa with identifier: NZ77836 to the API
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:56:55Z',
 'fuel_type': 'diesel',
 'id': 'fb8928e6-2aa1-56d6-ae0b-3dddf52310aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ77836',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 232588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-20',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 CDTI DPF Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ77836%27 HTTP/1.1" 200 None
2026-03-28 05:32:47 [auto1.de] INFO: Saving data for NZ77836: {'auction_closing_time': 1774717015.0, 'created_time': 1773226534.33956, 'last_price_update_time': 1774675967.732733}
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ77836') HTTP/1.1" 204 0
2026-03-28 05:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:47 [auto1.de] INFO: Found listing with ID: RH08953
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH08953%27 HTTP/1.1" 200 None
2026-03-28 05:32:47 [auto1.de] INFO: Scrape type for RH08953: 2
2026-03-28 05:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01530dc0-815c-50ff-85f8-bf65a1d65408 with identifier: RH08953
2026-03-28 05:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01530dc0-815c-50ff-85f8-bf65a1d65408 with scrape type 2
2026-03-28 05:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01530dc0-815c-50ff-85f8-bf65a1d65408 with scrape type 2
2026-03-28 05:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01530dc0-815c-50ff-85f8-bf65a1d65408, identifier: RH08953
2026-03-28 05:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01530dc0-815c-50ff-85f8-bf65a1d65408 with identifier: RH08953
2026-03-28 05:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01530dc0-815c-50ff-85f8-bf65a1d65408 with identifier: RH08953
2026-03-28 05:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01530dc0-815c-50ff-85f8-bf65a1d65408 with identifier: RH08953 to the API
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:45:57Z',
 'fuel_type': 'petrol',
 'id': '01530dc0-815c-50ff-85f8-bf65a1d65408',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH08953',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 194701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-01',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 TGDI Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2018}
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH08953%27 HTTP/1.1" 200 None
2026-03-28 05:32:48 [auto1.de] INFO: Saving data for RH08953: {'auction_closing_time': 1774716357.0, 'created_time': 1774550657.822303, 'last_price_update_time': 1774675968.294295}
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH08953') HTTP/1.1" 204 0
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: KS00518
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS00518%27 HTTP/1.1" 200 None
2026-03-28 05:32:48 [auto1.de] INFO: Scrape type for KS00518: 0
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-28 05:32:48 [auto1.de] INFO: Scrape type for FK00341: 2
2026-03-28 05:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341
2026-03-28 05:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd37cb63-2730-5a97-ad3c-c132ebb66158 with scrape type 2
2026-03-28 05:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd37cb63-2730-5a97-ad3c-c132ebb66158 with scrape type 2
2026-03-28 05:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd37cb63-2730-5a97-ad3c-c132ebb66158, identifier: FK00341
2026-03-28 05:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341
2026-03-28 05:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341
2026-03-28 05:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341 to the API
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:50Z',
 'fuel_type': 'petrol',
 'id': 'bd37cb63-2730-5a97-ad3c-c132ebb66158',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK00341',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 91338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-03',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2017}
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-28 05:32:48 [auto1.de] INFO: Saving data for FK00341: {'auction_closing_time': 1774717070.0, 'created_time': 1774552056.092032, 'last_price_update_time': 1774675968.733641}
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK00341') HTTP/1.1" 204 0
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: JP67472
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: TS09067
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS09067%27 HTTP/1.1" 200 None
2026-03-28 05:32:48 [auto1.de] INFO: Scrape type for TS09067: 0
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: ES63389
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES63389%27 HTTP/1.1" 200 None
2026-03-28 05:32:48 [auto1.de] INFO: Scrape type for ES63389: 0
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: SH15635
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH15635%27 HTTP/1.1" 200 None
2026-03-28 05:32:48 [auto1.de] INFO: Scrape type for SH15635: 0
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: XJ09013
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ09013%27 HTTP/1.1" 200 None
2026-03-28 05:32:48 [auto1.de] INFO: Scrape type for XJ09013: 0
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: HX06871
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX06871%27 HTTP/1.1" 200 None
2026-03-28 05:32:48 [auto1.de] INFO: Scrape type for HX06871: 0
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: BJ62941
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ62941%27 HTTP/1.1" 200 None
2026-03-28 05:32:48 [auto1.de] INFO: Scrape type for BJ62941: 0
2026-03-28 05:32:48 [auto1.de] INFO: Found listing with ID: ZR46884
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR46884%27 HTTP/1.1" 200 None
2026-03-28 05:32:49 [auto1.de] INFO: Scrape type for ZR46884: 2
2026-03-28 05:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b96af4c3-69ad-5fc5-8179-551358b359c2 with identifier: ZR46884
2026-03-28 05:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b96af4c3-69ad-5fc5-8179-551358b359c2 with scrape type 2
2026-03-28 05:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b96af4c3-69ad-5fc5-8179-551358b359c2 with scrape type 2
2026-03-28 05:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b96af4c3-69ad-5fc5-8179-551358b359c2, identifier: ZR46884
2026-03-28 05:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b96af4c3-69ad-5fc5-8179-551358b359c2 with identifier: ZR46884
2026-03-28 05:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b96af4c3-69ad-5fc5-8179-551358b359c2 with identifier: ZR46884
2026-03-28 05:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b96af4c3-69ad-5fc5-8179-551358b359c2 with identifier: ZR46884 to the API
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:39:54Z',
 'fuel_type': 'diesel',
 'id': 'b96af4c3-69ad-5fc5-8179-551358b359c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR46884',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 228376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-23',
 'seller_name': None,
 'title': 'Audi Q7 4.2 V8 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR46884%27 HTTP/1.1" 200 None
2026-03-28 05:32:49 [auto1.de] INFO: Saving data for ZR46884: {'auction_closing_time': 1774715994.0, 'created_time': 1774550152.60787, 'last_price_update_time': 1774675969.438597}
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR46884') HTTP/1.1" 204 0
2026-03-28 05:32:49 [auto1.de] INFO: Found listing with ID: YP80343
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP80343%27 HTTP/1.1" 200 None
2026-03-28 05:32:49 [auto1.de] INFO: Scrape type for YP80343: 0
2026-03-28 05:32:49 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-28 05:32:49 [auto1.de] INFO: Found listing with ID: AB71807
2026-03-28 05:32:49 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-28 05:32:49 [auto1.de] INFO: Scrape type for TJ52471: 0
2026-03-28 05:32:49 [auto1.de] INFO: Found listing with ID: CW94912
2026-03-28 05:32:49 [auto1.de] INFO: Found listing with ID: GL98026
2026-03-28 05:32:49 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-28 05:32:49 [auto1.de] INFO: Scrape type for YJ47814: 2
2026-03-28 05:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9936cd23-f63b-558a-9466-c755649fc40f with identifier: YJ47814
2026-03-28 05:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9936cd23-f63b-558a-9466-c755649fc40f with scrape type 2
2026-03-28 05:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9936cd23-f63b-558a-9466-c755649fc40f with scrape type 2
2026-03-28 05:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9936cd23-f63b-558a-9466-c755649fc40f, identifier: YJ47814
2026-03-28 05:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9936cd23-f63b-558a-9466-c755649fc40f with identifier: YJ47814
2026-03-28 05:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9936cd23-f63b-558a-9466-c755649fc40f with identifier: YJ47814
2026-03-28 05:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9936cd23-f63b-558a-9466-c755649fc40f with identifier: YJ47814 to the API
2026-03-28 05:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:42:38Z',
 'fuel_type': 'hybrid',
 'id': '9936cd23-f63b-558a-9466-c755649fc40f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ47814',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 50444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-05',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-28 05:32:50 [auto1.de] INFO: Saving data for YJ47814: {'auction_closing_time': 1774716158.0, 'created_time': 1774553059.022454, 'last_price_update_time': 1774675970.262071}
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ47814') HTTP/1.1" 204 0
2026-03-28 05:32:50 [auto1.de] INFO: Found listing with ID: TH04354
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04354%27 HTTP/1.1" 200 None
2026-03-28 05:32:50 [auto1.de] INFO: Scrape type for TH04354: 0
2026-03-28 05:32:50 [auto1.de] INFO: Found listing with ID: GZ39772
2026-03-28 05:32:50 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-28 05:32:50 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-28 05:32:50 [auto1.de] INFO: Found listing with ID: RB04302
2026-03-28 05:32:50 [auto1.de] INFO: Found listing with ID: JR64740
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR64740%27 HTTP/1.1" 200 None
2026-03-28 05:32:50 [auto1.de] INFO: Scrape type for JR64740: 0
2026-03-28 05:32:50 [auto1.de] INFO: Found listing with ID: UX27196
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX27196%27 HTTP/1.1" 200 None
2026-03-28 05:32:50 [auto1.de] INFO: Scrape type for UX27196: 0
2026-03-28 05:32:50 [auto1.de] INFO: Found listing with ID: DY53680
2026-03-28 05:32:50 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-28 05:32:50 [auto1.de] INFO: Scrape type for DW82351: 0
2026-03-28 05:32:50 [auto1.de] INFO: Found listing with ID: XU08667
2026-03-28 05:32:50 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-28 05:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:51 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:51 [auto1.de] INFO: Found listing with ID: SM94755
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94755%27 HTTP/1.1" 200 None
2026-03-28 05:32:51 [auto1.de] INFO: Scrape type for SM94755: 0
2026-03-28 05:32:51 [auto1.de] INFO: Found listing with ID: RA48340
2026-03-28 05:32:51 [auto1.de] INFO: Found listing with ID: LM34765
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM34765%27 HTTP/1.1" 200 None
2026-03-28 05:32:51 [auto1.de] INFO: Scrape type for LM34765: 0
2026-03-28 05:32:51 [auto1.de] INFO: Found listing with ID: GS63097
2026-03-28 05:32:51 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-28 05:32:51 [auto1.de] INFO: Found listing with ID: AP70373
2026-03-28 05:32:51 [auto1.de] INFO: Found listing with ID: DC45609
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC45609%27 HTTP/1.1" 200 None
2026-03-28 05:32:51 [auto1.de] INFO: Scrape type for DC45609: 0
2026-03-28 05:32:51 [auto1.de] INFO: Found listing with ID: FK07385
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07385%27 HTTP/1.1" 200 None
2026-03-28 05:32:51 [auto1.de] INFO: Scrape type for FK07385: 0
2026-03-28 05:32:51 [auto1.de] INFO: Found listing with ID: ZJ58005
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ58005%27 HTTP/1.1" 200 None
2026-03-28 05:32:51 [auto1.de] INFO: Scrape type for ZJ58005: 2
2026-03-28 05:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 433db7c5-a28e-50fb-aa34-2b7968eb5965 with identifier: ZJ58005
2026-03-28 05:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 433db7c5-a28e-50fb-aa34-2b7968eb5965 with scrape type 2
2026-03-28 05:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 433db7c5-a28e-50fb-aa34-2b7968eb5965 with scrape type 2
2026-03-28 05:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 433db7c5-a28e-50fb-aa34-2b7968eb5965, identifier: ZJ58005
2026-03-28 05:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 433db7c5-a28e-50fb-aa34-2b7968eb5965 with identifier: ZJ58005
2026-03-28 05:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 433db7c5-a28e-50fb-aa34-2b7968eb5965 with identifier: ZJ58005
2026-03-28 05:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 433db7c5-a28e-50fb-aa34-2b7968eb5965 with identifier: ZJ58005 to the API
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:16:08Z',
 'fuel_type': 'petrol',
 'id': '433db7c5-a28e-50fb-aa34-2b7968eb5965',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ58005',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 71430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-31',
 'seller_name': None,
 'title': 'Citroen C3 1.0 VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2014}
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ58005%27 HTTP/1.1" 200 None
2026-03-28 05:32:52 [auto1.de] INFO: Saving data for ZJ58005: {'auction_closing_time': 1774714568.0, 'created_time': 1774552889.968255, 'last_price_update_time': 1774675972.097503}
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ58005') HTTP/1.1" 204 0
2026-03-28 05:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:52 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-28 05:32:52 [auto1.de] INFO: Scrape type for ER69054: 2
2026-03-28 05:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39f08ffb-6c44-597f-b3d0-8a7d031c71db with identifier: ER69054
2026-03-28 05:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39f08ffb-6c44-597f-b3d0-8a7d031c71db with scrape type 2
2026-03-28 05:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39f08ffb-6c44-597f-b3d0-8a7d031c71db with scrape type 2
2026-03-28 05:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39f08ffb-6c44-597f-b3d0-8a7d031c71db, identifier: ER69054
2026-03-28 05:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39f08ffb-6c44-597f-b3d0-8a7d031c71db with identifier: ER69054
2026-03-28 05:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39f08ffb-6c44-597f-b3d0-8a7d031c71db with identifier: ER69054
2026-03-28 05:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39f08ffb-6c44-597f-b3d0-8a7d031c71db with identifier: ER69054 to the API
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:09:58Z',
 'fuel_type': 'diesel',
 'id': '39f08ffb-6c44-597f-b3d0-8a7d031c71db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER69054',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 97481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi Energy L4H1 3,5t',
 'transmission': 'manual',
 'trim': 'L4H1 3,5t',
 'year': 2023}
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-28 05:32:52 [auto1.de] INFO: Saving data for ER69054: {'auction_closing_time': 1774714198.0, 'created_time': 1774552492.631887, 'last_price_update_time': 1774675972.61607}
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER69054') HTTP/1.1" 204 0
2026-03-28 05:32:52 [auto1.de] INFO: Found listing with ID: NE18994
2026-03-28 05:32:52 [auto1.de] INFO: Found listing with ID: WT90781
2026-03-28 05:32:52 [auto1.de] INFO: Found listing with ID: SE64605
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE64605%27 HTTP/1.1" 200 None
2026-03-28 05:32:52 [auto1.de] INFO: Scrape type for SE64605: 2
2026-03-28 05:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with identifier: SE64605
2026-03-28 05:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with scrape type 2
2026-03-28 05:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with scrape type 2
2026-03-28 05:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1, identifier: SE64605
2026-03-28 05:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with identifier: SE64605
2026-03-28 05:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with identifier: SE64605
2026-03-28 05:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1 with identifier: SE64605 to the API
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:10Z',
 'fuel_type': 'petrol',
 'id': '4fd7fcc9-7f2a-5bae-aa5a-f0054f98b3f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE64605',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 82159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2014}
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE64605%27 HTTP/1.1" 200 None
2026-03-28 05:32:53 [auto1.de] INFO: Saving data for SE64605: {'auction_closing_time': 1774716790.0, 'created_time': 1773343648.533171, 'last_price_update_time': 1774675973.079744}
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE64605') HTTP/1.1" 204 0
2026-03-28 05:32:53 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-28 05:32:53 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX62858%27 HTTP/1.1" 200 None
2026-03-28 05:32:53 [auto1.de] INFO: Scrape type for FX62858: 0
2026-03-28 05:32:53 [auto1.de] INFO: Found listing with ID: FJ58428
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ58428%27 HTTP/1.1" 200 None
2026-03-28 05:32:53 [auto1.de] INFO: Scrape type for FJ58428: 2
2026-03-28 05:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b25ac47c-c4fd-52f3-9ef0-717f76d4e31d with identifier: FJ58428
2026-03-28 05:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b25ac47c-c4fd-52f3-9ef0-717f76d4e31d with scrape type 2
2026-03-28 05:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b25ac47c-c4fd-52f3-9ef0-717f76d4e31d with scrape type 2
2026-03-28 05:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b25ac47c-c4fd-52f3-9ef0-717f76d4e31d, identifier: FJ58428
2026-03-28 05:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b25ac47c-c4fd-52f3-9ef0-717f76d4e31d with identifier: FJ58428
2026-03-28 05:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b25ac47c-c4fd-52f3-9ef0-717f76d4e31d with identifier: FJ58428
2026-03-28 05:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b25ac47c-c4fd-52f3-9ef0-717f76d4e31d with identifier: FJ58428 to the API
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:16:30Z',
 'fuel_type': 'petrol',
 'id': 'b25ac47c-c4fd-52f3-9ef0-717f76d4e31d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ58428',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 70531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-25',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ58428%27 HTTP/1.1" 200 None
2026-03-28 05:32:53 [auto1.de] INFO: Saving data for FJ58428: {'auction_closing_time': 1774714590.0, 'created_time': 1773225774.615401, 'last_price_update_time': 1774675973.935296}
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ58428') HTTP/1.1" 204 0
2026-03-28 05:32:53 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-28 05:32:53 [auto1.de] INFO: Scrape type for UZ81937: 2
2026-03-28 05:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with identifier: UZ81937
2026-03-28 05:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with scrape type 2
2026-03-28 05:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with scrape type 2
2026-03-28 05:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a, identifier: UZ81937
2026-03-28 05:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with identifier: UZ81937
2026-03-28 05:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with identifier: UZ81937
2026-03-28 05:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with identifier: UZ81937 to the API
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:47:23Z',
 'fuel_type': 'hybrid',
 'id': 'e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ81937',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 53074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-28 05:32:54 [auto1.de] INFO: Saving data for UZ81937: {'auction_closing_time': 1774716443.0, 'created_time': 1774552354.984553, 'last_price_update_time': 1774675974.386241}
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ81937') HTTP/1.1" 204 0
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: TS91087
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: CS76410
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76410%27 HTTP/1.1" 200 None
2026-03-28 05:32:54 [auto1.de] INFO: Scrape type for CS76410: 0
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-28 05:32:54 [auto1.de] INFO: Scrape type for DW77262: 0
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: RZ52182
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: LU79813
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: NV48400
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: RX22945
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX24804%27 HTTP/1.1" 200 None
2026-03-28 05:32:54 [auto1.de] INFO: Scrape type for DX24804: 0
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: EN59108
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN59108%27 HTTP/1.1" 200 None
2026-03-28 05:32:54 [auto1.de] INFO: Scrape type for EN59108: 0
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: VF93957
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: EW00282
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-28 05:32:54 [auto1.de] INFO: Scrape type for BW06132: 0
2026-03-28 05:32:54 [auto1.de] INFO: Found listing with ID: ZV14288
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV14288%27 HTTP/1.1" 200 None
2026-03-28 05:32:54 [auto1.de] INFO: Scrape type for ZV14288: 2
2026-03-28 05:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36e6bbcc-3c42-57f1-b866-492bc559a10c with identifier: ZV14288
2026-03-28 05:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36e6bbcc-3c42-57f1-b866-492bc559a10c with scrape type 2
2026-03-28 05:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36e6bbcc-3c42-57f1-b866-492bc559a10c with scrape type 2
2026-03-28 05:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36e6bbcc-3c42-57f1-b866-492bc559a10c, identifier: ZV14288
2026-03-28 05:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36e6bbcc-3c42-57f1-b866-492bc559a10c with identifier: ZV14288
2026-03-28 05:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36e6bbcc-3c42-57f1-b866-492bc559a10c with identifier: ZV14288
2026-03-28 05:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36e6bbcc-3c42-57f1-b866-492bc559a10c with identifier: ZV14288 to the API
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:37:07Z',
 'fuel_type': 'diesel',
 'id': '36e6bbcc-3c42-57f1-b866-492bc559a10c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV14288',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse Marco Polo',
 'odometer': 73913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse Marco Polo V 250 d Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2019}
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV14288%27 HTTP/1.1" 200 None
2026-03-28 05:32:54 [auto1.de] INFO: Saving data for ZV14288: {'auction_closing_time': 1774715827.0, 'created_time': 1774463463.416956, 'last_price_update_time': 1774675974.97508}
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV14288') HTTP/1.1" 204 0
2026-03-28 05:32:55 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-28 05:32:55 [auto1.de] INFO: Scrape type for GS49465: 2
2026-03-28 05:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fa9163e-df51-5b78-b489-4f2b15385b8b with identifier: GS49465
2026-03-28 05:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fa9163e-df51-5b78-b489-4f2b15385b8b with scrape type 2
2026-03-28 05:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fa9163e-df51-5b78-b489-4f2b15385b8b with scrape type 2
2026-03-28 05:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fa9163e-df51-5b78-b489-4f2b15385b8b, identifier: GS49465
2026-03-28 05:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fa9163e-df51-5b78-b489-4f2b15385b8b with identifier: GS49465
2026-03-28 05:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fa9163e-df51-5b78-b489-4f2b15385b8b with identifier: GS49465
2026-03-28 05:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fa9163e-df51-5b78-b489-4f2b15385b8b with identifier: GS49465 to the API
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:34Z',
 'fuel_type': 'diesel',
 'id': '4fa9163e-df51-5b78-b489-4f2b15385b8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS49465',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 152754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-10',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D3 Ocean Race',
 'transmission': 'automatic',
 'trim': 'Ocean Race',
 'year': 2016}
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-28 05:32:55 [auto1.de] INFO: Saving data for GS49465: {'auction_closing_time': 1774715554.0, 'created_time': 1774552438.218976, 'last_price_update_time': 1774675975.499777}
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS49465') HTTP/1.1" 204 0
2026-03-28 05:32:55 [auto1.de] INFO: Found listing with ID: UR69038
2026-03-28 05:32:55 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-28 05:32:55 [auto1.de] INFO: Scrape type for VJ26450: 2
2026-03-28 05:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with identifier: VJ26450
2026-03-28 05:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with scrape type 2
2026-03-28 05:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with scrape type 2
2026-03-28 05:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4, identifier: VJ26450
2026-03-28 05:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with identifier: VJ26450
2026-03-28 05:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with identifier: VJ26450
2026-03-28 05:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with identifier: VJ26450 to the API
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:05:23Z',
 'fuel_type': 'diesel',
 'id': '044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ26450',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 216618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Cup',
 'transmission': 'manual',
 'trim': 'Cup',
 'year': 2015}
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-28 05:32:55 [auto1.de] INFO: Saving data for VJ26450: {'auction_closing_time': 1774713923.0, 'created_time': 1774550441.134085, 'last_price_update_time': 1774675975.939496}
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ26450') HTTP/1.1" 204 0
2026-03-28 05:32:55 [auto1.de] INFO: Found listing with ID: VK29139
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK29139%27 HTTP/1.1" 200 None
2026-03-28 05:32:55 [auto1.de] INFO: Scrape type for VK29139: 0
2026-03-28 05:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:32:56 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 9199 | hits on page: 40
2026-03-28 05:32:56 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-28 05:32:56 [auto1.de] INFO: Found listing with ID: KZ84912
2026-03-28 05:32:56 [auto1.de] INFO: Found listing with ID: CR80817
2026-03-28 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR80817%27 HTTP/1.1" 200 None
2026-03-28 05:32:56 [auto1.de] INFO: Scrape type for CR80817: 0
2026-03-28 05:32:56 [auto1.de] INFO: Found listing with ID: CF81636
2026-03-28 05:32:56 [auto1.de] INFO: Found listing with ID: GD73586
2026-03-28 05:32:56 [auto1.de] INFO: Found listing with ID: FA74860
2026-03-28 05:32:56 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-28 05:32:56 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-28 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-28 05:32:56 [auto1.de] INFO: Scrape type for WW55400: 2
2026-03-28 05:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with identifier: WW55400
2026-03-28 05:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with scrape type 2
2026-03-28 05:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with scrape type 2
2026-03-28 05:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b, identifier: WW55400
2026-03-28 05:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with identifier: WW55400
2026-03-28 05:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with identifier: WW55400
2026-03-28 05:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with identifier: WW55400 to the API
2026-03-28 05:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:12:05Z',
 'fuel_type': 'diesel',
 'id': 'e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW55400',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 241037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-12',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-28 05:32:56 [auto1.de] INFO: Saving data for WW55400: {'auction_closing_time': 1774714325.0, 'created_time': 1774552121.220486, 'last_price_update_time': 1774675976.974636}
2026-03-28 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW55400') HTTP/1.1" 204 0
2026-03-28 05:32:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: RV71441
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-28 05:32:57 [auto1.de] INFO: Scrape type for BA95413: 0
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: PR29926
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: BV83779
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-28 05:32:57 [auto1.de] INFO: Scrape type for HM11779: 2
2026-03-28 05:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with identifier: HM11779
2026-03-28 05:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with scrape type 2
2026-03-28 05:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with scrape type 2
2026-03-28 05:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a484ee1-2344-5f8a-9c1e-2c97b64033bd, identifier: HM11779
2026-03-28 05:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with identifier: HM11779
2026-03-28 05:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with identifier: HM11779
2026-03-28 05:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with identifier: HM11779 to the API
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:04:40Z',
 'fuel_type': 'diesel',
 'id': '6a484ee1-2344-5f8a-9c1e-2c97b64033bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM11779',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 310796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-05',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-28 05:32:57 [auto1.de] INFO: Saving data for HM11779: {'auction_closing_time': 1774713880.0, 'created_time': 1774552690.84911, 'last_price_update_time': 1774675977.541356}
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM11779') HTTP/1.1" 204 0
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: FA89686
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: MZ57576
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: DU90887
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: NB32533
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: LR77482
2026-03-28 05:32:57 [auto1.de] INFO: Found listing with ID: TY77956
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY77956%27 HTTP/1.1" 200 None
2026-03-28 05:32:57 [auto1.de] INFO: Scrape type for TY77956: 2
2026-03-28 05:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f9ee563-3764-5574-af46-020c40ac04ad with identifier: TY77956
2026-03-28 05:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f9ee563-3764-5574-af46-020c40ac04ad with scrape type 2
2026-03-28 05:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f9ee563-3764-5574-af46-020c40ac04ad with scrape type 2
2026-03-28 05:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f9ee563-3764-5574-af46-020c40ac04ad, identifier: TY77956
2026-03-28 05:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f9ee563-3764-5574-af46-020c40ac04ad with identifier: TY77956
2026-03-28 05:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f9ee563-3764-5574-af46-020c40ac04ad with identifier: TY77956
2026-03-28 05:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f9ee563-3764-5574-af46-020c40ac04ad with identifier: TY77956 to the API
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:16:08Z',
 'fuel_type': 'diesel',
 'id': '4f9ee563-3764-5574-af46-020c40ac04ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY77956',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60 Cross Country',
 'odometer': 252482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-28',
 'seller_name': None,
 'title': 'Volvo S60 Cross Country 2.0 D4 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2016}
2026-03-28 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY77956%27 HTTP/1.1" 200 None
2026-03-28 05:32:58 [auto1.de] INFO: Saving data for TY77956: {'auction_closing_time': 1774714568.0, 'created_time': 1773229188.315829, 'last_price_update_time': 1774675978.02906}
2026-03-28 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY77956') HTTP/1.1" 204 0
2026-03-28 05:32:58 [auto1.de] INFO: Found listing with ID: NC83571
2026-03-28 05:32:58 [auto1.de] INFO: Found listing with ID: MA82889
2026-03-28 05:32:58 [auto1.de] INFO: Found listing with ID: EG84867
2026-03-28 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG84867%27 HTTP/1.1" 200 None
2026-03-28 05:32:58 [auto1.de] INFO: Scrape type for EG84867: 0
2026-03-28 05:32:58 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-28 05:32:58 [auto1.de] INFO: Found listing with ID: FA82480
2026-03-28 05:32:58 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-28 05:32:58 [auto1.de] INFO: Found listing with ID: TS72146
2026-03-28 05:32:58 [auto1.de] INFO: Found listing with ID: HY62017
2026-03-28 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62017%27 HTTP/1.1" 200 None
2026-03-28 05:32:58 [auto1.de] INFO: Scrape type for HY62017: 0
2026-03-28 05:32:58 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-28 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-28 05:32:58 [auto1.de] INFO: Scrape type for LG80642: 2
2026-03-28 05:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with identifier: LG80642
2026-03-28 05:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with scrape type 2
2026-03-28 05:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with scrape type 2
2026-03-28 05:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76f837e7-5dd9-5da5-88c9-5e49d4fefad8, identifier: LG80642
2026-03-28 05:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with identifier: LG80642
2026-03-28 05:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with identifier: LG80642
2026-03-28 05:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with identifier: LG80642 to the API
2026-03-28 05:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:31:35Z',
 'fuel_type': 'diesel',
 'id': '76f837e7-5dd9-5da5-88c9-5e49d4fefad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG80642',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 121428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-28 05:32:59 [auto1.de] INFO: Saving data for LG80642: {'auction_closing_time': 1774715495.0, 'created_time': 1774550648.898186, 'last_price_update_time': 1774675979.395181}
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG80642') HTTP/1.1" 204 0
2026-03-28 05:32:59 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-28 05:32:59 [auto1.de] INFO: Scrape type for EC39473: 2
2026-03-28 05:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec3e464e-613d-5d59-961b-a82012f2016b with identifier: EC39473
2026-03-28 05:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec3e464e-613d-5d59-961b-a82012f2016b with scrape type 2
2026-03-28 05:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec3e464e-613d-5d59-961b-a82012f2016b with scrape type 2
2026-03-28 05:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec3e464e-613d-5d59-961b-a82012f2016b, identifier: EC39473
2026-03-28 05:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec3e464e-613d-5d59-961b-a82012f2016b with identifier: EC39473
2026-03-28 05:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec3e464e-613d-5d59-961b-a82012f2016b with identifier: EC39473
2026-03-28 05:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec3e464e-613d-5d59-961b-a82012f2016b with identifier: EC39473 to the API
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:13:46Z',
 'fuel_type': 'petrol',
 'id': 'ec3e464e-613d-5d59-961b-a82012f2016b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC39473',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Lancer',
 'odometer': 170662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-08',
 'seller_name': None,
 'title': 'Mitsubishi Lancer 1.6 Diamant Edition',
 'transmission': 'manual',
 'trim': 'Diamant Edition',
 'year': 2015}
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-28 05:32:59 [auto1.de] INFO: Saving data for EC39473: {'auction_closing_time': 1774714426.0, 'created_time': 1774552092.673794, 'last_price_update_time': 1774675979.83746}
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC39473') HTTP/1.1" 204 0
2026-03-28 05:32:59 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-28 05:32:59 [auto1.de] INFO: Scrape type for NU91903: 2
2026-03-28 05:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903
2026-03-28 05:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9264353-4757-570c-80f7-56324704a887 with scrape type 2
2026-03-28 05:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9264353-4757-570c-80f7-56324704a887 with scrape type 2
2026-03-28 05:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9264353-4757-570c-80f7-56324704a887, identifier: NU91903
2026-03-28 05:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903
2026-03-28 05:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903
2026-03-28 05:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903 to the API
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:59:41Z',
 'fuel_type': 'diesel',
 'id': 'a9264353-4757-570c-80f7-56324704a887',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU91903',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 294162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-06-30',
 'seller_name': None,
 'title': 'Ford Ranger 2.5 TD Extrakabine 4x4',
 'transmission': 'manual',
 'trim': 'Extrakabine 4x4',
 'year': 1996}
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-28 05:33:00 [auto1.de] INFO: Saving data for NU91903: {'auction_closing_time': 1774717181.0, 'created_time': 1774552774.43453, 'last_price_update_time': 1774675980.294026}
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU91903') HTTP/1.1" 204 0
2026-03-28 05:33:00 [auto1.de] INFO: Found listing with ID: NN85060
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN85060%27 HTTP/1.1" 200 None
2026-03-28 05:33:00 [auto1.de] INFO: Scrape type for NN85060: 0
2026-03-28 05:33:00 [auto1.de] INFO: Found listing with ID: WG82326
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG82326%27 HTTP/1.1" 200 None
2026-03-28 05:33:00 [auto1.de] INFO: Scrape type for WG82326: 0
2026-03-28 05:33:00 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP78735%27 HTTP/1.1" 200 None
2026-03-28 05:33:00 [auto1.de] INFO: Scrape type for BP78735: 0
2026-03-28 05:33:00 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-28 05:33:00 [auto1.de] INFO: Found listing with ID: SB50854
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50854%27 HTTP/1.1" 200 None
2026-03-28 05:33:00 [auto1.de] INFO: Scrape type for SB50854: 2
2026-03-28 05:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ab2910e-8a05-556c-84be-cf69c0a894b2 with identifier: SB50854
2026-03-28 05:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ab2910e-8a05-556c-84be-cf69c0a894b2 with scrape type 2
2026-03-28 05:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ab2910e-8a05-556c-84be-cf69c0a894b2 with scrape type 2
2026-03-28 05:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ab2910e-8a05-556c-84be-cf69c0a894b2, identifier: SB50854
2026-03-28 05:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ab2910e-8a05-556c-84be-cf69c0a894b2 with identifier: SB50854
2026-03-28 05:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ab2910e-8a05-556c-84be-cf69c0a894b2 with identifier: SB50854
2026-03-28 05:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ab2910e-8a05-556c-84be-cf69c0a894b2 with identifier: SB50854 to the API
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:28:01Z',
 'fuel_type': 'petrol',
 'id': '9ab2910e-8a05-556c-84be-cf69c0a894b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB50854',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 82839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-25',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50854%27 HTTP/1.1" 200 None
2026-03-28 05:33:00 [auto1.de] INFO: Saving data for SB50854: {'auction_closing_time': 1774715281.0, 'created_time': 1774552709.590273, 'last_price_update_time': 1774675980.881126}
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB50854') HTTP/1.1" 204 0
2026-03-28 05:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:01 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:01 [auto1.de] INFO: Found listing with ID: JC70183
2026-03-28 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC70183%27 HTTP/1.1" 200 None
2026-03-28 05:33:01 [auto1.de] INFO: Scrape type for JC70183: 2
2026-03-28 05:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: addc4e17-83fe-5592-bc06-ec2a98a7339f with identifier: JC70183
2026-03-28 05:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item addc4e17-83fe-5592-bc06-ec2a98a7339f with scrape type 2
2026-03-28 05:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item addc4e17-83fe-5592-bc06-ec2a98a7339f with scrape type 2
2026-03-28 05:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: addc4e17-83fe-5592-bc06-ec2a98a7339f, identifier: JC70183
2026-03-28 05:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: addc4e17-83fe-5592-bc06-ec2a98a7339f with identifier: JC70183
2026-03-28 05:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: addc4e17-83fe-5592-bc06-ec2a98a7339f with identifier: JC70183
2026-03-28 05:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: addc4e17-83fe-5592-bc06-ec2a98a7339f with identifier: JC70183 to the API
2026-03-28 05:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:50:50Z',
 'fuel_type': 'petrol',
 'id': 'addc4e17-83fe-5592-bc06-ec2a98a7339f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC70183',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 26302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2020}
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC70183%27 HTTP/1.1" 200 None
2026-03-28 05:33:02 [auto1.de] INFO: Saving data for JC70183: {'auction_closing_time': 1774716650.0, 'created_time': 1774552765.784936, 'last_price_update_time': 1774675982.385652}
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC70183') HTTP/1.1" 204 0
2026-03-28 05:33:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:02 [auto1.de] INFO: Found listing with ID: WS56575
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS56575%27 HTTP/1.1" 200 None
2026-03-28 05:33:02 [auto1.de] INFO: Scrape type for WS56575: 0
2026-03-28 05:33:02 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-28 05:33:02 [auto1.de] INFO: Found listing with ID: XT08306
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08306%27 HTTP/1.1" 200 None
2026-03-28 05:33:02 [auto1.de] INFO: Scrape type for XT08306: 0
2026-03-28 05:33:02 [auto1.de] INFO: Found listing with ID: LS92579
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92579%27 HTTP/1.1" 200 None
2026-03-28 05:33:02 [auto1.de] INFO: Scrape type for LS92579: 0
2026-03-28 05:33:02 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-28 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-28 05:33:03 [auto1.de] INFO: Scrape type for PX47030: 2
2026-03-28 05:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4abea932-9320-5b89-8001-dcef59e7e5e4 with identifier: PX47030
2026-03-28 05:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4abea932-9320-5b89-8001-dcef59e7e5e4 with scrape type 2
2026-03-28 05:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4abea932-9320-5b89-8001-dcef59e7e5e4 with scrape type 2
2026-03-28 05:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4abea932-9320-5b89-8001-dcef59e7e5e4, identifier: PX47030
2026-03-28 05:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4abea932-9320-5b89-8001-dcef59e7e5e4 with identifier: PX47030
2026-03-28 05:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4abea932-9320-5b89-8001-dcef59e7e5e4 with identifier: PX47030
2026-03-28 05:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4abea932-9320-5b89-8001-dcef59e7e5e4 with identifier: PX47030 to the API
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:12:21Z',
 'fuel_type': 'petrol',
 'id': '4abea932-9320-5b89-8001-dcef59e7e5e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX47030',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 169752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-28 05:33:03 [auto1.de] INFO: Saving data for PX47030: {'auction_closing_time': 1774714341.0, 'created_time': 1774552563.881598, 'last_price_update_time': 1774675983.392417}
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX47030') HTTP/1.1" 204 0
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: AD32766
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD32766%27 HTTP/1.1" 200 None
2026-03-28 05:33:03 [auto1.de] INFO: Scrape type for AD32766: 0
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: RJ41827
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ41827%27 HTTP/1.1" 200 None
2026-03-28 05:33:03 [auto1.de] INFO: Scrape type for RJ41827: 0
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: XS15243
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: KH60913
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH60913%27 HTTP/1.1" 200 None
2026-03-28 05:33:03 [auto1.de] INFO: Scrape type for KH60913: 0
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: SD51082
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: GC08040
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08040%27 HTTP/1.1" 200 None
2026-03-28 05:33:03 [auto1.de] INFO: Scrape type for GC08040: 0
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-28 05:33:03 [auto1.de] INFO: Scrape type for ZY60733: 0
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: VP92353
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP92353%27 HTTP/1.1" 200 None
2026-03-28 05:33:03 [auto1.de] INFO: Scrape type for VP92353: 0
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: AC60710
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC60710%27 HTTP/1.1" 200 None
2026-03-28 05:33:03 [auto1.de] INFO: Scrape type for AC60710: 0
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: XU27440
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: ZW69442
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: GG79095
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG79095%27 HTTP/1.1" 200 None
2026-03-28 05:33:03 [auto1.de] INFO: Scrape type for GG79095: 0
2026-03-28 05:33:03 [auto1.de] INFO: Found listing with ID: ZV46118
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV46118%27 HTTP/1.1" 200 None
2026-03-28 05:33:03 [auto1.de] INFO: Scrape type for ZV46118: 2
2026-03-28 05:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50347242-e8a5-52d2-8fba-475db432c044 with identifier: ZV46118
2026-03-28 05:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50347242-e8a5-52d2-8fba-475db432c044 with scrape type 2
2026-03-28 05:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50347242-e8a5-52d2-8fba-475db432c044 with scrape type 2
2026-03-28 05:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50347242-e8a5-52d2-8fba-475db432c044, identifier: ZV46118
2026-03-28 05:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50347242-e8a5-52d2-8fba-475db432c044 with identifier: ZV46118
2026-03-28 05:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50347242-e8a5-52d2-8fba-475db432c044 with identifier: ZV46118
2026-03-28 05:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50347242-e8a5-52d2-8fba-475db432c044 with identifier: ZV46118 to the API
2026-03-28 05:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:51:32Z',
 'fuel_type': 'petrol',
 'id': '50347242-e8a5-52d2-8fba-475db432c044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV46118',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 63434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-02',
 'seller_name': None,
 'title': 'MINI John Cooper Works',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV46118%27 HTTP/1.1" 200 None
2026-03-28 05:33:04 [auto1.de] INFO: Saving data for ZV46118: {'auction_closing_time': 1774716692.0, 'created_time': 1774463621.394773, 'last_price_update_time': 1774675984.423521}
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV46118') HTTP/1.1" 204 0
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG12821%27 HTTP/1.1" 200 None
2026-03-28 05:33:04 [auto1.de] INFO: Scrape type for VG12821: 0
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: XJ72982
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: LX72474
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: VU02651
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: ZS42305
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: NF12246
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: RS99660
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS99660%27 HTTP/1.1" 200 None
2026-03-28 05:33:04 [auto1.de] INFO: Scrape type for RS99660: 0
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: LW97378
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: KP56505
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP56505%27 HTTP/1.1" 200 None
2026-03-28 05:33:04 [auto1.de] INFO: Scrape type for KP56505: 0
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-28 05:33:04 [auto1.de] INFO: Found listing with ID: JL26666
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL26666%27 HTTP/1.1" 200 None
2026-03-28 05:33:04 [auto1.de] INFO: Scrape type for JL26666: 2
2026-03-28 05:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ca6966c-18c1-5956-934b-18a4dfe6cd7a with identifier: JL26666
2026-03-28 05:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca6966c-18c1-5956-934b-18a4dfe6cd7a with scrape type 2
2026-03-28 05:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ca6966c-18c1-5956-934b-18a4dfe6cd7a with scrape type 2
2026-03-28 05:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ca6966c-18c1-5956-934b-18a4dfe6cd7a, identifier: JL26666
2026-03-28 05:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ca6966c-18c1-5956-934b-18a4dfe6cd7a with identifier: JL26666
2026-03-28 05:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ca6966c-18c1-5956-934b-18a4dfe6cd7a with identifier: JL26666
2026-03-28 05:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ca6966c-18c1-5956-934b-18a4dfe6cd7a with identifier: JL26666 to the API
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:13:35Z',
 'fuel_type': 'petrol',
 'id': '5ca6966c-18c1-5956-934b-18a4dfe6cd7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL26666',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 208005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-22',
 'seller_name': None,
 'title': 'Nissan Juke 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-28 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL26666%27 HTTP/1.1" 200 None
2026-03-28 05:33:05 [auto1.de] INFO: Saving data for JL26666: {'auction_closing_time': 1774714415.0, 'created_time': 1774552735.019084, 'last_price_update_time': 1774675985.015828}
2026-03-28 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL26666') HTTP/1.1" 204 0
2026-03-28 05:33:05 [auto1.de] INFO: Found listing with ID: AL43539
2026-03-28 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL43539%27 HTTP/1.1" 200 None
2026-03-28 05:33:05 [auto1.de] INFO: Scrape type for AL43539: 0
2026-03-28 05:33:05 [auto1.de] INFO: Found listing with ID: LT28781
2026-03-28 05:33:05 [auto1.de] INFO: Found listing with ID: RW46423
2026-03-28 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW46423%27 HTTP/1.1" 200 None
2026-03-28 05:33:05 [auto1.de] INFO: Scrape type for RW46423: 0
2026-03-28 05:33:05 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-28 05:33:05 [auto1.de] INFO: Found listing with ID: NP20797
2026-03-28 05:33:05 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-28 05:33:05 [auto1.de] INFO: Found listing with ID: RE78828
2026-03-28 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE78828%27 HTTP/1.1" 200 None
2026-03-28 05:33:05 [auto1.de] INFO: Scrape type for RE78828: 0
2026-03-28 05:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:06 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:06 [auto1.de] INFO: Found listing with ID: VX80468
2026-03-28 05:33:06 [auto1.de] INFO: Found listing with ID: LF99231
2026-03-28 05:33:06 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-28 05:33:06 [auto1.de] INFO: Found listing with ID: YE53774
2026-03-28 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE53774%27 HTTP/1.1" 200 None
2026-03-28 05:33:06 [auto1.de] INFO: Scrape type for YE53774: 0
2026-03-28 05:33:06 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-28 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-28 05:33:06 [auto1.de] INFO: Scrape type for PP24406: 2
2026-03-28 05:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45b6e915-4847-52ef-baf2-0f35e469953b with identifier: PP24406
2026-03-28 05:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45b6e915-4847-52ef-baf2-0f35e469953b with scrape type 2
2026-03-28 05:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45b6e915-4847-52ef-baf2-0f35e469953b with scrape type 2
2026-03-28 05:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45b6e915-4847-52ef-baf2-0f35e469953b, identifier: PP24406
2026-03-28 05:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45b6e915-4847-52ef-baf2-0f35e469953b with identifier: PP24406
2026-03-28 05:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45b6e915-4847-52ef-baf2-0f35e469953b with identifier: PP24406
2026-03-28 05:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45b6e915-4847-52ef-baf2-0f35e469953b with identifier: PP24406 to the API
2026-03-28 05:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:10:41Z',
 'fuel_type': 'petrol',
 'id': '45b6e915-4847-52ef-baf2-0f35e469953b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP24406',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 33839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2023}
2026-03-28 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-28 05:33:07 [auto1.de] INFO: Saving data for PP24406: {'auction_closing_time': 1774714241.0, 'created_time': 1774550476.836465, 'last_price_update_time': 1774675987.731794}
2026-03-28 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP24406') HTTP/1.1" 204 0
2026-03-28 05:33:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:07 [auto1.de] INFO: Found listing with ID: YH42279
2026-03-28 05:33:07 [auto1.de] INFO: Found listing with ID: US02373
2026-03-28 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-28 05:33:07 [auto1.de] INFO: Scrape type for US02373: 2
2026-03-28 05:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef963ded-ff2c-5818-b62e-a1e915283ebb with identifier: US02373
2026-03-28 05:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef963ded-ff2c-5818-b62e-a1e915283ebb with scrape type 2
2026-03-28 05:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef963ded-ff2c-5818-b62e-a1e915283ebb with scrape type 2
2026-03-28 05:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef963ded-ff2c-5818-b62e-a1e915283ebb, identifier: US02373
2026-03-28 05:33:07 [scrapy.extensions.logstats] INFO: Crawled 70 pages (at 15 pages/min), scraped 201 items (at 88 items/min)
2026-03-28 05:33:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef963ded-ff2c-5818-b62e-a1e915283ebb with identifier: US02373
2026-03-28 05:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef963ded-ff2c-5818-b62e-a1e915283ebb with identifier: US02373
2026-03-28 05:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef963ded-ff2c-5818-b62e-a1e915283ebb with identifier: US02373 to the API
2026-03-28 05:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:39:05Z',
 'fuel_type': 'petrol',
 'id': 'ef963ded-ff2c-5818-b62e-a1e915283ebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US02373',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 238715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-14',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-28 05:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-28 05:33:08 [auto1.de] INFO: Saving data for US02373: {'auction_closing_time': 1774715945.0, 'created_time': 1774550904.014831, 'last_price_update_time': 1774675988.785315}
2026-03-28 05:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US02373') HTTP/1.1" 204 0
2026-03-28 05:33:08 [auto1.de] INFO: Found listing with ID: UP47374
2026-03-28 05:33:08 [auto1.de] INFO: Found listing with ID: PS14610
2026-03-28 05:33:08 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-28 05:33:08 [auto1.de] INFO: Found listing with ID: SL60140
2026-03-28 05:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60140%27 HTTP/1.1" 200 None
2026-03-28 05:33:08 [auto1.de] INFO: Scrape type for SL60140: 2
2026-03-28 05:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9270ba-f576-5a83-a675-968b5c18c8bb with identifier: SL60140
2026-03-28 05:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a9270ba-f576-5a83-a675-968b5c18c8bb with scrape type 2
2026-03-28 05:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a9270ba-f576-5a83-a675-968b5c18c8bb with scrape type 2
2026-03-28 05:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a9270ba-f576-5a83-a675-968b5c18c8bb, identifier: SL60140
2026-03-28 05:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a9270ba-f576-5a83-a675-968b5c18c8bb with identifier: SL60140
2026-03-28 05:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a9270ba-f576-5a83-a675-968b5c18c8bb with identifier: SL60140
2026-03-28 05:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a9270ba-f576-5a83-a675-968b5c18c8bb with identifier: SL60140 to the API
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:16:27Z',
 'fuel_type': 'diesel',
 'id': '9a9270ba-f576-5a83-a675-968b5c18c8bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL60140',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 177690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 250 d Shooting Brake BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60140%27 HTTP/1.1" 200 None
2026-03-28 05:33:09 [auto1.de] INFO: Saving data for SL60140: {'auction_closing_time': 1774714587.0, 'created_time': 1774463650.040181, 'last_price_update_time': 1774675989.275732}
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL60140') HTTP/1.1" 204 0
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: RC15993
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC15993%27 HTTP/1.1" 200 None
2026-03-28 05:33:09 [auto1.de] INFO: Scrape type for RC15993: 0
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: NF90345
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF90345%27 HTTP/1.1" 200 None
2026-03-28 05:33:09 [auto1.de] INFO: Scrape type for NF90345: 0
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: SD48131
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: NR21254
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR21254%27 HTTP/1.1" 200 None
2026-03-28 05:33:09 [auto1.de] INFO: Scrape type for NR21254: 0
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: GR74650
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR74650%27 HTTP/1.1" 200 None
2026-03-28 05:33:09 [auto1.de] INFO: Scrape type for GR74650: 0
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-28 05:33:09 [auto1.de] INFO: Scrape type for SP00408: 0
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-28 05:33:09 [auto1.de] INFO: Scrape type for SC26693: 2
2026-03-28 05:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with identifier: SC26693
2026-03-28 05:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with scrape type 2
2026-03-28 05:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with scrape type 2
2026-03-28 05:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44, identifier: SC26693
2026-03-28 05:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with identifier: SC26693
2026-03-28 05:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with identifier: SC26693
2026-03-28 05:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with identifier: SC26693 to the API
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:36Z',
 'fuel_type': 'diesel',
 'id': '67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC26693',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 108241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-25',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Exclusive-Line',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line',
 'year': 2016}
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-28 05:33:09 [auto1.de] INFO: Saving data for SC26693: {'auction_closing_time': 1774715736.0, 'created_time': 1774550340.921691, 'last_price_update_time': 1774675989.807142}
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC26693') HTTP/1.1" 204 0
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: VH89235
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: LU81602
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-28 05:33:09 [auto1.de] INFO: Scrape type for LN93862: 0
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: NR78378
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR78378%27 HTTP/1.1" 200 None
2026-03-28 05:33:09 [auto1.de] INFO: Scrape type for NR78378: 0
2026-03-28 05:33:09 [auto1.de] INFO: Found listing with ID: MR59336
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR59336%27 HTTP/1.1" 200 None
2026-03-28 05:33:09 [auto1.de] INFO: Scrape type for MR59336: 2
2026-03-28 05:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bcb16f6-845e-5d33-890e-94b74152d5ad with identifier: MR59336
2026-03-28 05:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bcb16f6-845e-5d33-890e-94b74152d5ad with scrape type 2
2026-03-28 05:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bcb16f6-845e-5d33-890e-94b74152d5ad with scrape type 2
2026-03-28 05:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bcb16f6-845e-5d33-890e-94b74152d5ad, identifier: MR59336
2026-03-28 05:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bcb16f6-845e-5d33-890e-94b74152d5ad with identifier: MR59336
2026-03-28 05:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bcb16f6-845e-5d33-890e-94b74152d5ad with identifier: MR59336
2026-03-28 05:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bcb16f6-845e-5d33-890e-94b74152d5ad with identifier: MR59336 to the API
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:51Z',
 'fuel_type': 'petrol',
 'id': '3bcb16f6-845e-5d33-890e-94b74152d5ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR59336',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 181899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-20',
 'seller_name': None,
 'title': 'Renault Grand Scenic 2.0 Dynamique',
 'transmission': 'automatic',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR59336%27 HTTP/1.1" 200 None
2026-03-28 05:33:10 [auto1.de] INFO: Saving data for MR59336: {'auction_closing_time': 1774717011.0, 'created_time': 1773224717.031606, 'last_price_update_time': 1774675990.368979}
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR59336') HTTP/1.1" 204 0
2026-03-28 05:33:10 [auto1.de] INFO: Found listing with ID: KT31788
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT31788%27 HTTP/1.1" 200 None
2026-03-28 05:33:10 [auto1.de] INFO: Scrape type for KT31788: 0
2026-03-28 05:33:10 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-28 05:33:10 [auto1.de] INFO: Found listing with ID: PV86472
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV86472%27 HTTP/1.1" 200 None
2026-03-28 05:33:10 [auto1.de] INFO: Scrape type for PV86472: 0
2026-03-28 05:33:10 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-28 05:33:10 [auto1.de] INFO: Scrape type for GX75432: 0
2026-03-28 05:33:10 [auto1.de] INFO: Found listing with ID: RM29704
2026-03-28 05:33:10 [auto1.de] INFO: Found listing with ID: DF78416
2026-03-28 05:33:10 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF74386%27 HTTP/1.1" 200 None
2026-03-28 05:33:10 [auto1.de] INFO: Scrape type for CF74386: 0
2026-03-28 05:33:10 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-28 05:33:10 [auto1.de] INFO: Found listing with ID: ZU61173
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61173%27 HTTP/1.1" 200 None
2026-03-28 05:33:10 [auto1.de] INFO: Scrape type for ZU61173: 2
2026-03-28 05:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ad22f16-ec0b-5bd3-af25-4ace0f89d74c with identifier: ZU61173
2026-03-28 05:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ad22f16-ec0b-5bd3-af25-4ace0f89d74c with scrape type 2
2026-03-28 05:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ad22f16-ec0b-5bd3-af25-4ace0f89d74c with scrape type 2
2026-03-28 05:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ad22f16-ec0b-5bd3-af25-4ace0f89d74c, identifier: ZU61173
2026-03-28 05:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ad22f16-ec0b-5bd3-af25-4ace0f89d74c with identifier: ZU61173
2026-03-28 05:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ad22f16-ec0b-5bd3-af25-4ace0f89d74c with identifier: ZU61173
2026-03-28 05:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ad22f16-ec0b-5bd3-af25-4ace0f89d74c with identifier: ZU61173 to the API
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:59:35Z',
 'fuel_type': 'petrol',
 'id': '8ad22f16-ec0b-5bd3-af25-4ace0f89d74c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU61173',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 143323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Scout 4x4',
 'transmission': 'automatic',
 'trim': 'Scout 4x4',
 'year': 2017}
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61173%27 HTTP/1.1" 200 None
2026-03-28 05:33:10 [auto1.de] INFO: Saving data for ZU61173: {'auction_closing_time': 1774717175.0, 'created_time': 1774552709.136488, 'last_price_update_time': 1774675990.887813}
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU61173') HTTP/1.1" 204 0
2026-03-28 05:33:10 [auto1.de] INFO: Found listing with ID: NP44902
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP44902%27 HTTP/1.1" 200 None
2026-03-28 05:33:11 [auto1.de] INFO: Scrape type for NP44902: 0
2026-03-28 05:33:11 [auto1.de] INFO: Found listing with ID: UX06727
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX06727%27 HTTP/1.1" 200 None
2026-03-28 05:33:11 [auto1.de] INFO: Scrape type for UX06727: 0
2026-03-28 05:33:11 [auto1.de] INFO: Found listing with ID: UE16674
2026-03-28 05:33:11 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-28 05:33:11 [auto1.de] INFO: Scrape type for RX78682: 0
2026-03-28 05:33:11 [auto1.de] INFO: Found listing with ID: PF21402
2026-03-28 05:33:11 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-28 05:33:11 [auto1.de] INFO: Found listing with ID: DB02068
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB02068%27 HTTP/1.1" 200 None
2026-03-28 05:33:11 [auto1.de] INFO: Scrape type for DB02068: 0
2026-03-28 05:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:11 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:11 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-28 05:33:11 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-28 05:33:11 [auto1.de] INFO: Scrape type for EU38402: 0
2026-03-28 05:33:11 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-28 05:33:11 [auto1.de] INFO: Found listing with ID: DN90837
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN90837%27 HTTP/1.1" 200 None
2026-03-28 05:33:11 [auto1.de] INFO: Scrape type for DN90837: 2
2026-03-28 05:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98ffea14-490e-55d1-8bb4-6c04c08ace64 with identifier: DN90837
2026-03-28 05:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98ffea14-490e-55d1-8bb4-6c04c08ace64 with scrape type 2
2026-03-28 05:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98ffea14-490e-55d1-8bb4-6c04c08ace64 with scrape type 2
2026-03-28 05:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98ffea14-490e-55d1-8bb4-6c04c08ace64, identifier: DN90837
2026-03-28 05:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98ffea14-490e-55d1-8bb4-6c04c08ace64 with identifier: DN90837
2026-03-28 05:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98ffea14-490e-55d1-8bb4-6c04c08ace64 with identifier: DN90837
2026-03-28 05:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98ffea14-490e-55d1-8bb4-6c04c08ace64 with identifier: DN90837 to the API
2026-03-28 05:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:15:50Z',
 'fuel_type': 'petrol',
 'id': '98ffea14-490e-55d1-8bb4-6c04c08ace64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN90837',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 5954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-09',
 'seller_name': None,
 'title': 'Audi A1 Sportback 25 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN90837%27 HTTP/1.1" 200 None
2026-03-28 05:33:13 [auto1.de] INFO: Saving data for DN90837: {'auction_closing_time': 1774714550.0, 'created_time': 1774552065.934182, 'last_price_update_time': 1774675993.248887}
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN90837') HTTP/1.1" 204 0
2026-03-28 05:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:13 [auto1.de] INFO: Found listing with ID: DC86459
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC86459%27 HTTP/1.1" 200 None
2026-03-28 05:33:13 [auto1.de] INFO: Scrape type for DC86459: 0
2026-03-28 05:33:13 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-28 05:33:13 [auto1.de] INFO: Scrape type for UW48203: 2
2026-03-28 05:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d742f411-4b37-545c-b17c-109982748acd with identifier: UW48203
2026-03-28 05:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d742f411-4b37-545c-b17c-109982748acd with scrape type 2
2026-03-28 05:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d742f411-4b37-545c-b17c-109982748acd with scrape type 2
2026-03-28 05:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d742f411-4b37-545c-b17c-109982748acd, identifier: UW48203
2026-03-28 05:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d742f411-4b37-545c-b17c-109982748acd with identifier: UW48203
2026-03-28 05:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d742f411-4b37-545c-b17c-109982748acd with identifier: UW48203
2026-03-28 05:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d742f411-4b37-545c-b17c-109982748acd with identifier: UW48203 to the API
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:19:30Z',
 'fuel_type': 'petrol',
 'id': 'd742f411-4b37-545c-b17c-109982748acd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW48203',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 125084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2010}
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-28 05:33:13 [auto1.de] INFO: Saving data for UW48203: {'auction_closing_time': 1774714770.0, 'created_time': 1774552638.662167, 'last_price_update_time': 1774675993.776515}
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW48203') HTTP/1.1" 204 0
2026-03-28 05:33:13 [auto1.de] INFO: Found listing with ID: GX87234
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX87234%27 HTTP/1.1" 200 None
2026-03-28 05:33:13 [auto1.de] INFO: Scrape type for GX87234: 0
2026-03-28 05:33:13 [auto1.de] INFO: Found listing with ID: FD35505
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD35505%27 HTTP/1.1" 200 None
2026-03-28 05:33:13 [auto1.de] INFO: Scrape type for FD35505: 0
2026-03-28 05:33:13 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-28 05:33:13 [auto1.de] INFO: Scrape type for LK34875: 0
2026-03-28 05:33:13 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-28 05:33:13 [auto1.de] INFO: Scrape type for LW85167: 0
2026-03-28 05:33:13 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-28 05:33:13 [auto1.de] INFO: Scrape type for YA77478: 2
2026-03-28 05:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd710a63-9fee-5217-8e6e-983924419a04 with identifier: YA77478
2026-03-28 05:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd710a63-9fee-5217-8e6e-983924419a04 with scrape type 2
2026-03-28 05:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd710a63-9fee-5217-8e6e-983924419a04 with scrape type 2
2026-03-28 05:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd710a63-9fee-5217-8e6e-983924419a04, identifier: YA77478
2026-03-28 05:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd710a63-9fee-5217-8e6e-983924419a04 with identifier: YA77478
2026-03-28 05:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd710a63-9fee-5217-8e6e-983924419a04 with identifier: YA77478
2026-03-28 05:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd710a63-9fee-5217-8e6e-983924419a04 with identifier: YA77478 to the API
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:33:12Z',
 'fuel_type': 'diesel',
 'id': 'fd710a63-9fee-5217-8e6e-983924419a04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA77478',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 175715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion',
 'year': 2017}
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-28 05:33:14 [auto1.de] INFO: Saving data for YA77478: {'auction_closing_time': 1774715592.0, 'created_time': 1774551869.129841, 'last_price_update_time': 1774675994.284419}
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA77478') HTTP/1.1" 204 0
2026-03-28 05:33:14 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-28 05:33:14 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-28 05:33:14 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-28 05:33:14 [auto1.de] INFO: Scrape type for WY19584: 0
2026-03-28 05:33:14 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-28 05:33:14 [auto1.de] INFO: Found listing with ID: CF23775
2026-03-28 05:33:14 [auto1.de] INFO: Found listing with ID: AC62471
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC62471%27 HTTP/1.1" 200 None
2026-03-28 05:33:14 [auto1.de] INFO: Scrape type for AC62471: 0
2026-03-28 05:33:14 [auto1.de] INFO: Found listing with ID: LJ59261
2026-03-28 05:33:14 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-28 05:33:14 [auto1.de] INFO: Scrape type for EE77460: 2
2026-03-28 05:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460
2026-03-28 05:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541fd090-9fa2-584e-ad07-6100c00deb31 with scrape type 2
2026-03-28 05:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541fd090-9fa2-584e-ad07-6100c00deb31 with scrape type 2
2026-03-28 05:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541fd090-9fa2-584e-ad07-6100c00deb31, identifier: EE77460
2026-03-28 05:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460
2026-03-28 05:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460
2026-03-28 05:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460 to the API
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:51:16Z',
 'fuel_type': 'petrol',
 'id': '541fd090-9fa2-584e-ad07-6100c00deb31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE77460',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 102839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-02',
 'seller_name': None,
 'title': 'Smart forfour 1.0 youngster',
 'transmission': 'manual',
 'trim': 'youngster',
 'year': 2018}
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-28 05:33:14 [auto1.de] INFO: Saving data for EE77460: {'auction_closing_time': 1774716676.0, 'created_time': 1774552151.520308, 'last_price_update_time': 1774675994.752937}
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE77460') HTTP/1.1" 204 0
2026-03-28 05:33:14 [auto1.de] INFO: Found listing with ID: HR49435
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR49435%27 HTTP/1.1" 200 None
2026-03-28 05:33:14 [auto1.de] INFO: Scrape type for HR49435: 0
2026-03-28 05:33:14 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-28 05:33:14 [auto1.de] INFO: Scrape type for LM30127: 2
2026-03-28 05:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61119cb4-a9e1-559e-a654-2bf3e678064b with identifier: LM30127
2026-03-28 05:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61119cb4-a9e1-559e-a654-2bf3e678064b with scrape type 2
2026-03-28 05:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61119cb4-a9e1-559e-a654-2bf3e678064b with scrape type 2
2026-03-28 05:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61119cb4-a9e1-559e-a654-2bf3e678064b, identifier: LM30127
2026-03-28 05:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61119cb4-a9e1-559e-a654-2bf3e678064b with identifier: LM30127
2026-03-28 05:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61119cb4-a9e1-559e-a654-2bf3e678064b with identifier: LM30127
2026-03-28 05:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61119cb4-a9e1-559e-a654-2bf3e678064b with identifier: LM30127 to the API
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:02:13Z',
 'fuel_type': 'petrol',
 'id': '61119cb4-a9e1-559e-a654-2bf3e678064b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM30127',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 145920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-06',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2009}
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-28 05:33:15 [auto1.de] INFO: Saving data for LM30127: {'auction_closing_time': 1774713733.0, 'created_time': 1774552927.889865, 'last_price_update_time': 1774675995.277691}
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM30127') HTTP/1.1" 204 0
2026-03-28 05:33:15 [auto1.de] INFO: Found listing with ID: EM14245
2026-03-28 05:33:15 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-28 05:33:15 [auto1.de] INFO: Scrape type for HW30650: 2
2026-03-28 05:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a13de3dc-47c1-59ba-b79e-6f0e9be52523 with identifier: HW30650
2026-03-28 05:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a13de3dc-47c1-59ba-b79e-6f0e9be52523 with scrape type 2
2026-03-28 05:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a13de3dc-47c1-59ba-b79e-6f0e9be52523 with scrape type 2
2026-03-28 05:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a13de3dc-47c1-59ba-b79e-6f0e9be52523, identifier: HW30650
2026-03-28 05:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a13de3dc-47c1-59ba-b79e-6f0e9be52523 with identifier: HW30650
2026-03-28 05:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a13de3dc-47c1-59ba-b79e-6f0e9be52523 with identifier: HW30650
2026-03-28 05:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a13de3dc-47c1-59ba-b79e-6f0e9be52523 with identifier: HW30650 to the API
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:11:01Z',
 'fuel_type': 'petrol',
 'id': 'a13de3dc-47c1-59ba-b79e-6f0e9be52523',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW30650',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 201711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-28',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2005}
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-28 05:33:15 [auto1.de] INFO: Saving data for HW30650: {'auction_closing_time': 1774714261.0, 'created_time': 1774552443.303493, 'last_price_update_time': 1774675995.718019}
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW30650') HTTP/1.1" 204 0
2026-03-28 05:33:15 [auto1.de] INFO: Found listing with ID: NF21329
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF21329%27 HTTP/1.1" 200 None
2026-03-28 05:33:15 [auto1.de] INFO: Scrape type for NF21329: 0
2026-03-28 05:33:15 [auto1.de] INFO: Found listing with ID: ZJ77365
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ77365%27 HTTP/1.1" 200 None
2026-03-28 05:33:15 [auto1.de] INFO: Scrape type for ZJ77365: 0
2026-03-28 05:33:15 [auto1.de] INFO: Found listing with ID: GB55666
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB55666%27 HTTP/1.1" 200 None
2026-03-28 05:33:15 [auto1.de] INFO: Scrape type for GB55666: 0
2026-03-28 05:33:15 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-28 05:33:15 [auto1.de] INFO: Scrape type for XT00440: 0
2026-03-28 05:33:15 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-28 05:33:15 [auto1.de] INFO: Found listing with ID: UK10359
2026-03-28 05:33:15 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-28 05:33:15 [auto1.de] INFO: Scrape type for MS75707: 2
2026-03-28 05:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e19d6518-c79e-5e63-b444-b62a9e53ea97 with identifier: MS75707
2026-03-28 05:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19d6518-c79e-5e63-b444-b62a9e53ea97 with scrape type 2
2026-03-28 05:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e19d6518-c79e-5e63-b444-b62a9e53ea97 with scrape type 2
2026-03-28 05:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e19d6518-c79e-5e63-b444-b62a9e53ea97, identifier: MS75707
2026-03-28 05:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e19d6518-c79e-5e63-b444-b62a9e53ea97 with identifier: MS75707
2026-03-28 05:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e19d6518-c79e-5e63-b444-b62a9e53ea97 with identifier: MS75707
2026-03-28 05:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e19d6518-c79e-5e63-b444-b62a9e53ea97 with identifier: MS75707 to the API
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:29:14Z',
 'fuel_type': 'diesel',
 'id': 'e19d6518-c79e-5e63-b444-b62a9e53ea97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS75707',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 200525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-14',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-28 05:33:16 [auto1.de] INFO: Saving data for MS75707: {'auction_closing_time': 1774715354.0, 'created_time': 1774550532.497225, 'last_price_update_time': 1774675996.255134}
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS75707') HTTP/1.1" 204 0
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: NY96268
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY96268%27 HTTP/1.1" 200 None
2026-03-28 05:33:16 [auto1.de] INFO: Scrape type for NY96268: 0
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: HX46872
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: DE17947
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-28 05:33:16 [auto1.de] INFO: Scrape type for YC50370: 0
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-28 05:33:16 [auto1.de] INFO: Scrape type for XS21978: 2
2026-03-28 05:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293682dc-f0a0-5b2b-861e-ada7da75bb19 with identifier: XS21978
2026-03-28 05:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293682dc-f0a0-5b2b-861e-ada7da75bb19 with scrape type 2
2026-03-28 05:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293682dc-f0a0-5b2b-861e-ada7da75bb19 with scrape type 2
2026-03-28 05:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 293682dc-f0a0-5b2b-861e-ada7da75bb19, identifier: XS21978
2026-03-28 05:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 293682dc-f0a0-5b2b-861e-ada7da75bb19 with identifier: XS21978
2026-03-28 05:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 293682dc-f0a0-5b2b-861e-ada7da75bb19 with identifier: XS21978
2026-03-28 05:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 293682dc-f0a0-5b2b-861e-ada7da75bb19 with identifier: XS21978 to the API
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:18:17Z',
 'fuel_type': 'diesel',
 'id': '293682dc-f0a0-5b2b-861e-ada7da75bb19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS21978',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 93979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.8 CRD Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2015}
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-28 05:33:16 [auto1.de] INFO: Saving data for XS21978: {'auction_closing_time': 1774714697.0, 'created_time': 1774589445.05818, 'last_price_update_time': 1774675996.817111}
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS21978') HTTP/1.1" 204 0
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: VM56295
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM56295%27 HTTP/1.1" 200 None
2026-03-28 05:33:16 [auto1.de] INFO: Scrape type for VM56295: 0
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: RR66654
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR66654%27 HTTP/1.1" 200 None
2026-03-28 05:33:16 [auto1.de] INFO: Scrape type for RR66654: 0
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: RW07323
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-28 05:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:16 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: AE93304
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: PM54102
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM54102%27 HTTP/1.1" 200 None
2026-03-28 05:33:16 [auto1.de] INFO: Scrape type for PM54102: 0
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-28 05:33:16 [auto1.de] INFO: Scrape type for ZJ39351: 0
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-28 05:33:16 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-28 05:33:17 [auto1.de] INFO: Scrape type for VT43931: 0
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: DS40784
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: GE94573
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94573%27 HTTP/1.1" 200 None
2026-03-28 05:33:17 [auto1.de] INFO: Scrape type for GE94573: 0
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: KJ26847
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ26847%27 HTTP/1.1" 200 None
2026-03-28 05:33:17 [auto1.de] INFO: Scrape type for KJ26847: 0
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: AN17735
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN17735%27 HTTP/1.1" 200 None
2026-03-28 05:33:17 [auto1.de] INFO: Scrape type for AN17735: 0
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: NE28687
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: JT80939
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT80939%27 HTTP/1.1" 200 None
2026-03-28 05:33:17 [auto1.de] INFO: Scrape type for JT80939: 0
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-28 05:33:17 [auto1.de] INFO: Scrape type for CZ44674: 0
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: DM27064
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: AK06166
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK06166%27 HTTP/1.1" 200 None
2026-03-28 05:33:17 [auto1.de] INFO: Scrape type for AK06166: 0
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: RD74576
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD74576%27 HTTP/1.1" 200 None
2026-03-28 05:33:17 [auto1.de] INFO: Scrape type for RD74576: 0
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: KN88175
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN88175%27 HTTP/1.1" 200 None
2026-03-28 05:33:17 [auto1.de] INFO: Scrape type for KN88175: 0
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: MV92075
2026-03-28 05:33:17 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-28 05:33:17 [auto1.de] INFO: Scrape type for RG01801: 2
2026-03-28 05:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801
2026-03-28 05:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fecde1-f447-581f-a0b5-aefa61776a37 with scrape type 2
2026-03-28 05:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47fecde1-f447-581f-a0b5-aefa61776a37 with scrape type 2
2026-03-28 05:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47fecde1-f447-581f-a0b5-aefa61776a37, identifier: RG01801
2026-03-28 05:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801
2026-03-28 05:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801
2026-03-28 05:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801 to the API
2026-03-28 05:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:53:17Z',
 'fuel_type': 'diesel',
 'id': '47fecde1-f447-581f-a0b5-aefa61776a37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG01801',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 219874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-17',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Comfortline BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Maxi Comfortline BlueMotion Tech.',
 'year': 2013}
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-28 05:33:18 [auto1.de] INFO: Saving data for RG01801: {'auction_closing_time': 1774716797.0, 'created_time': 1774550431.685973, 'last_price_update_time': 1774675998.246618}
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG01801') HTTP/1.1" 204 0
2026-03-28 05:33:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:18 [auto1.de] INFO: Found listing with ID: LC82989
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC82989%27 HTTP/1.1" 200 None
2026-03-28 05:33:18 [auto1.de] INFO: Scrape type for LC82989: 0
2026-03-28 05:33:18 [auto1.de] INFO: Found listing with ID: DL83760
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL83760%27 HTTP/1.1" 200 None
2026-03-28 05:33:18 [auto1.de] INFO: Scrape type for DL83760: 0
2026-03-28 05:33:18 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-28 05:33:18 [auto1.de] INFO: Scrape type for AG08443: 0
2026-03-28 05:33:18 [auto1.de] INFO: Found listing with ID: VK16260
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK16260%27 HTTP/1.1" 200 None
2026-03-28 05:33:18 [auto1.de] INFO: Scrape type for VK16260: 2
2026-03-28 05:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae19ee51-d441-5cb1-805f-c0ffd5564309 with identifier: VK16260
2026-03-28 05:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae19ee51-d441-5cb1-805f-c0ffd5564309 with scrape type 2
2026-03-28 05:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae19ee51-d441-5cb1-805f-c0ffd5564309 with scrape type 2
2026-03-28 05:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae19ee51-d441-5cb1-805f-c0ffd5564309, identifier: VK16260
2026-03-28 05:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae19ee51-d441-5cb1-805f-c0ffd5564309 with identifier: VK16260
2026-03-28 05:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae19ee51-d441-5cb1-805f-c0ffd5564309 with identifier: VK16260
2026-03-28 05:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae19ee51-d441-5cb1-805f-c0ffd5564309 with identifier: VK16260 to the API
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:29:42Z',
 'fuel_type': 'petrol',
 'id': 'ae19ee51-d441-5cb1-805f-c0ffd5564309',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK16260',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 4915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-23',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2021}
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK16260%27 HTTP/1.1" 200 None
2026-03-28 05:33:18 [auto1.de] INFO: Saving data for VK16260: {'auction_closing_time': 1774715382.0, 'created_time': 1774503069.310269, 'last_price_update_time': 1774675998.835401}
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK16260') HTTP/1.1" 204 0
2026-03-28 05:33:18 [auto1.de] INFO: Found listing with ID: NT22490
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT22490%27 HTTP/1.1" 200 None
2026-03-28 05:33:18 [auto1.de] INFO: Scrape type for NT22490: 2
2026-03-28 05:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f1c835c-e0d1-5f13-9348-444a582ccb71 with identifier: NT22490
2026-03-28 05:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f1c835c-e0d1-5f13-9348-444a582ccb71 with scrape type 2
2026-03-28 05:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f1c835c-e0d1-5f13-9348-444a582ccb71 with scrape type 2
2026-03-28 05:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f1c835c-e0d1-5f13-9348-444a582ccb71, identifier: NT22490
2026-03-28 05:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f1c835c-e0d1-5f13-9348-444a582ccb71 with identifier: NT22490
2026-03-28 05:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f1c835c-e0d1-5f13-9348-444a582ccb71 with identifier: NT22490
2026-03-28 05:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f1c835c-e0d1-5f13-9348-444a582ccb71 with identifier: NT22490 to the API
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:19:57Z',
 'fuel_type': 'diesel',
 'id': '0f1c835c-e0d1-5f13-9348-444a582ccb71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT22490',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 154776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT22490%27 HTTP/1.1" 200 None
2026-03-28 05:33:19 [auto1.de] INFO: Saving data for NT22490: {'auction_closing_time': 1774714797.0, 'created_time': 1774466195.19285, 'last_price_update_time': 1774675999.319505}
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT22490') HTTP/1.1" 204 0
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: ZX04970
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX04970%27 HTTP/1.1" 200 None
2026-03-28 05:33:19 [auto1.de] INFO: Scrape type for ZX04970: 0
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: KN35431
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN35431%27 HTTP/1.1" 200 None
2026-03-28 05:33:19 [auto1.de] INFO: Scrape type for KN35431: 0
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: JM96313
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: UX25395
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-28 05:33:19 [auto1.de] INFO: Scrape type for EM69554: 2
2026-03-28 05:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554
2026-03-28 05:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with scrape type 2
2026-03-28 05:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with scrape type 2
2026-03-28 05:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e, identifier: EM69554
2026-03-28 05:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554
2026-03-28 05:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554
2026-03-28 05:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554 to the API
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:19:25Z',
 'fuel_type': 'petrol',
 'id': '84b7ba83-b1ef-583f-a99b-c4dab9b3c21e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM69554',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 176440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-26',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-28 05:33:19 [auto1.de] INFO: Saving data for EM69554: {'auction_closing_time': 1774714765.0, 'created_time': 1773229236.068166, 'last_price_update_time': 1774675999.785195}
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM69554') HTTP/1.1" 204 0
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: AS81057
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: DL24086
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL24086%27 HTTP/1.1" 200 None
2026-03-28 05:33:19 [auto1.de] INFO: Scrape type for DL24086: 0
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: LS75828
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: NX05955
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: PJ28903
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ28903%27 HTTP/1.1" 200 None
2026-03-28 05:33:19 [auto1.de] INFO: Scrape type for PJ28903: 0
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: KN21474
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: ZL05657
2026-03-28 05:33:19 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-28 05:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:20 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:20 [auto1.de] INFO: Found listing with ID: MA14721
2026-03-28 05:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA14721%27 HTTP/1.1" 200 None
2026-03-28 05:33:20 [auto1.de] INFO: Scrape type for MA14721: 0
2026-03-28 05:33:20 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-28 05:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-28 05:33:20 [auto1.de] INFO: Scrape type for MK93259: 0
2026-03-28 05:33:20 [auto1.de] INFO: Found listing with ID: YH51203
2026-03-28 05:33:20 [auto1.de] INFO: Found listing with ID: VR19710
2026-03-28 05:33:20 [auto1.de] INFO: Found listing with ID: XJ13626
2026-03-28 05:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ13626%27 HTTP/1.1" 200 None
2026-03-28 05:33:20 [auto1.de] INFO: Scrape type for XJ13626: 0
2026-03-28 05:33:20 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-28 05:33:20 [auto1.de] INFO: Found listing with ID: VL76600
2026-03-28 05:33:20 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-28 05:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-28 05:33:20 [auto1.de] INFO: Scrape type for VB93359: 2
2026-03-28 05:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with identifier: VB93359
2026-03-28 05:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with scrape type 2
2026-03-28 05:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with scrape type 2
2026-03-28 05:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02df93b2-897d-5ea7-9f37-9ee2e441cfbb, identifier: VB93359
2026-03-28 05:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with identifier: VB93359
2026-03-28 05:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with identifier: VB93359
2026-03-28 05:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with identifier: VB93359 to the API
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:42:30Z',
 'fuel_type': 'diesel',
 'id': '02df93b2-897d-5ea7-9f37-9ee2e441cfbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB93359',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 60458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 CDTI Elegance L (L3)',
 'transmission': 'automatic',
 'trim': 'Elegance L (L3)',
 'year': 2021}
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-28 05:33:21 [auto1.de] INFO: Saving data for VB93359: {'auction_closing_time': 1774716150.0, 'created_time': 1774552491.216636, 'last_price_update_time': 1774676001.308815}
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB93359') HTTP/1.1" 204 0
2026-03-28 05:33:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:21 [auto1.de] INFO: Found listing with ID: CR93470
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR93470%27 HTTP/1.1" 200 None
2026-03-28 05:33:21 [auto1.de] INFO: Scrape type for CR93470: 0
2026-03-28 05:33:21 [auto1.de] INFO: Found listing with ID: FK98108
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK98108%27 HTTP/1.1" 200 None
2026-03-28 05:33:21 [auto1.de] INFO: Scrape type for FK98108: 0
2026-03-28 05:33:21 [auto1.de] INFO: Found listing with ID: LB19367
2026-03-28 05:33:21 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-28 05:33:21 [auto1.de] INFO: Found listing with ID: ZM18653
2026-03-28 05:33:21 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-28 05:33:21 [auto1.de] INFO: Scrape type for BE16908: 2
2026-03-28 05:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02a173ab-74cf-5c13-94ff-1ae50b536a56 with identifier: BE16908
2026-03-28 05:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02a173ab-74cf-5c13-94ff-1ae50b536a56 with scrape type 2
2026-03-28 05:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02a173ab-74cf-5c13-94ff-1ae50b536a56 with scrape type 2
2026-03-28 05:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02a173ab-74cf-5c13-94ff-1ae50b536a56, identifier: BE16908
2026-03-28 05:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02a173ab-74cf-5c13-94ff-1ae50b536a56 with identifier: BE16908
2026-03-28 05:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02a173ab-74cf-5c13-94ff-1ae50b536a56 with identifier: BE16908
2026-03-28 05:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02a173ab-74cf-5c13-94ff-1ae50b536a56 with identifier: BE16908 to the API
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:19:44Z',
 'fuel_type': 'diesel',
 'id': '02a173ab-74cf-5c13-94ff-1ae50b536a56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE16908',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 286202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-09',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-28 05:33:21 [auto1.de] INFO: Saving data for BE16908: {'auction_closing_time': 1774714784.0, 'created_time': 1774552599.759703, 'last_price_update_time': 1774676001.866264}
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE16908') HTTP/1.1" 204 0
2026-03-28 05:33:21 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-28 05:33:21 [auto1.de] INFO: Scrape type for HV99123: 2
2026-03-28 05:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with identifier: HV99123
2026-03-28 05:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with scrape type 2
2026-03-28 05:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with scrape type 2
2026-03-28 05:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f, identifier: HV99123
2026-03-28 05:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with identifier: HV99123
2026-03-28 05:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with identifier: HV99123
2026-03-28 05:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with identifier: HV99123 to the API
2026-03-28 05:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:34Z',
 'fuel_type': 'petrol',
 'id': 'e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV99123',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 160121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-20',
 'seller_name': None,
 'title': 'Opel Zafira 2.2 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2006}
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-28 05:33:23 [auto1.de] INFO: Saving data for HV99123: {'auction_closing_time': 1774713814.0, 'created_time': 1774589452.654502, 'last_price_update_time': 1774676003.252214}
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV99123') HTTP/1.1" 204 0
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: MR24892
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: KL40189
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: YS87471
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS87471%27 HTTP/1.1" 200 None
2026-03-28 05:33:23 [auto1.de] INFO: Scrape type for YS87471: 0
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: EJ76475
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ76475%27 HTTP/1.1" 200 None
2026-03-28 05:33:23 [auto1.de] INFO: Scrape type for EJ76475: 0
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: LL66986
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: UD68347
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: XE71423
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE71423%27 HTTP/1.1" 200 None
2026-03-28 05:33:23 [auto1.de] INFO: Scrape type for XE71423: 0
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: SG45173
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45173%27 HTTP/1.1" 200 None
2026-03-28 05:33:23 [auto1.de] INFO: Scrape type for SG45173: 0
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: GV75599
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: YT66272
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-28 05:33:23 [auto1.de] INFO: Scrape type for HR44152: 2
2026-03-28 05:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aed92b33-2167-5eec-b130-54903dbdde14 with identifier: HR44152
2026-03-28 05:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aed92b33-2167-5eec-b130-54903dbdde14 with scrape type 2
2026-03-28 05:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aed92b33-2167-5eec-b130-54903dbdde14 with scrape type 2
2026-03-28 05:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aed92b33-2167-5eec-b130-54903dbdde14, identifier: HR44152
2026-03-28 05:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aed92b33-2167-5eec-b130-54903dbdde14 with identifier: HR44152
2026-03-28 05:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aed92b33-2167-5eec-b130-54903dbdde14 with identifier: HR44152
2026-03-28 05:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aed92b33-2167-5eec-b130-54903dbdde14 with identifier: HR44152 to the API
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-28T16:28:56Z',
 'fuel_type': 'petrol',
 'id': 'aed92b33-2167-5eec-b130-54903dbdde14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR44152',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 137292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-29',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2010}
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-28 05:33:23 [auto1.de] INFO: Saving data for HR44152: {'auction_closing_time': 1774715336.0, 'created_time': 1774552534.322653, 'last_price_update_time': 1774676003.762542}
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR44152') HTTP/1.1" 204 0
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-28 05:33:23 [auto1.de] INFO: Scrape type for JU26227: 0
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: MK96538
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: DB03654
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: KL31519
2026-03-28 05:33:23 [auto1.de] INFO: Found listing with ID: AY28505
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY28505%27 HTTP/1.1" 200 None
2026-03-28 05:33:23 [auto1.de] INFO: Scrape type for AY28505: 2
2026-03-28 05:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43277a7f-7efc-558a-93d7-aa7fe9b261a7 with identifier: AY28505
2026-03-28 05:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43277a7f-7efc-558a-93d7-aa7fe9b261a7 with scrape type 2
2026-03-28 05:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43277a7f-7efc-558a-93d7-aa7fe9b261a7 with scrape type 2
2026-03-28 05:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43277a7f-7efc-558a-93d7-aa7fe9b261a7, identifier: AY28505
2026-03-28 05:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43277a7f-7efc-558a-93d7-aa7fe9b261a7 with identifier: AY28505
2026-03-28 05:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43277a7f-7efc-558a-93d7-aa7fe9b261a7 with identifier: AY28505
2026-03-28 05:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43277a7f-7efc-558a-93d7-aa7fe9b261a7 with identifier: AY28505 to the API
2026-03-28 05:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:46:41Z',
 'fuel_type': 'petrol',
 'id': '43277a7f-7efc-558a-93d7-aa7fe9b261a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY28505',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 120659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-12',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo 120 Jahre Start/Stop',
 'transmission': 'manual',
 'trim': '120 Jahre Start/Stop',
 'year': 2019}
2026-03-28 05:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY28505%27 HTTP/1.1" 200 None
2026-03-28 05:33:24 [auto1.de] INFO: Saving data for AY28505: {'auction_closing_time': 1774716401.0, 'created_time': 1774463648.360688, 'last_price_update_time': 1774676004.301287}
2026-03-28 05:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY28505') HTTP/1.1" 204 0
2026-03-28 05:33:24 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-28 05:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63476%27 HTTP/1.1" 200 None
2026-03-28 05:33:24 [auto1.de] INFO: Scrape type for LD63476: 0
2026-03-28 05:33:24 [auto1.de] INFO: Found listing with ID: DE25074
2026-03-28 05:33:24 [auto1.de] INFO: Found listing with ID: RU14902
2026-03-28 05:33:24 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-28 05:33:24 [auto1.de] INFO: Found listing with ID: FL34122
2026-03-28 05:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:25 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:25 [auto1.de] INFO: Found listing with ID: WT95105
2026-03-28 05:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT95105%27 HTTP/1.1" 200 None
2026-03-28 05:33:25 [auto1.de] INFO: Scrape type for WT95105: 0
2026-03-28 05:33:25 [auto1.de] INFO: Found listing with ID: RX16022
2026-03-28 05:33:25 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-28 05:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-28 05:33:25 [auto1.de] INFO: Scrape type for XR15758: 2
2026-03-28 05:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eaafb08-a723-543d-b0e3-83469eee03f8 with identifier: XR15758
2026-03-28 05:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eaafb08-a723-543d-b0e3-83469eee03f8 with scrape type 2
2026-03-28 05:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eaafb08-a723-543d-b0e3-83469eee03f8 with scrape type 2
2026-03-28 05:33:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eaafb08-a723-543d-b0e3-83469eee03f8, identifier: XR15758
2026-03-28 05:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eaafb08-a723-543d-b0e3-83469eee03f8 with identifier: XR15758
2026-03-28 05:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eaafb08-a723-543d-b0e3-83469eee03f8 with identifier: XR15758
2026-03-28 05:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eaafb08-a723-543d-b0e3-83469eee03f8 with identifier: XR15758 to the API
2026-03-28 05:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:33Z',
 'fuel_type': 'diesel',
 'id': '6eaafb08-a723-543d-b0e3-83469eee03f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR15758',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 226430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-24',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2016}
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Saving data for XR15758: {'auction_closing_time': 1774713933.0, 'created_time': 1774552725.593311, 'last_price_update_time': 1774676006.043234}
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR15758') HTTP/1.1" 204 0
2026-03-28 05:33:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: YT74468
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: KA35826
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA35826%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for KA35826: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: RN29221
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN29221%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for RN29221: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: XV23695
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: JW40764
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW40764%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for JW40764: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: LM46522
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46522%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for LM46522: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: YN88329
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN88329%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for YN88329: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: KA32583
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: YE96502
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: ZW02435
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: CS43152
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for ZV83127: 2
2026-03-28 05:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with identifier: ZV83127
2026-03-28 05:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with scrape type 2
2026-03-28 05:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with scrape type 2
2026-03-28 05:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 720b8c5b-27e1-5a4f-97fa-3a9affa9806e, identifier: ZV83127
2026-03-28 05:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with identifier: ZV83127
2026-03-28 05:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with identifier: ZV83127
2026-03-28 05:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with identifier: ZV83127 to the API
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:33:15Z',
 'fuel_type': 'diesel',
 'id': '720b8c5b-27e1-5a4f-97fa-3a9affa9806e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV83127',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 148927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-20',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Business',
 'transmission': 'automatic',
 'trim': 'Q4 Business',
 'year': 2019}
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Saving data for ZV83127: {'auction_closing_time': 1774715595.0, 'created_time': 1773343385.55687, 'last_price_update_time': 1774676006.665755}
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV83127') HTTP/1.1" 204 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: SX08307
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08307%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for SX08307: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: WW55447
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55447%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for WW55447: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: XJ15035
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ15035%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for XJ15035: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: JF53186
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: CU82641
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: GN50341
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50341%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for GN50341: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88762%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for ZM88762: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: AG19353
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: XH14540
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH14540%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for XH14540: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: CL78510
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: MH03153
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03153%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for MH03153: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: FN85811
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: TR50455
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: RL02084
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL02084%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for RL02084: 0
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: JK78478
2026-03-28 05:33:26 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-28 05:33:26 [auto1.de] INFO: Scrape type for LL09458: 2
2026-03-28 05:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5942ad7-b395-525b-8cf9-a58fcdd5027f with identifier: LL09458
2026-03-28 05:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5942ad7-b395-525b-8cf9-a58fcdd5027f with scrape type 2
2026-03-28 05:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5942ad7-b395-525b-8cf9-a58fcdd5027f with scrape type 2
2026-03-28 05:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5942ad7-b395-525b-8cf9-a58fcdd5027f, identifier: LL09458
2026-03-28 05:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5942ad7-b395-525b-8cf9-a58fcdd5027f with identifier: LL09458
2026-03-28 05:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5942ad7-b395-525b-8cf9-a58fcdd5027f with identifier: LL09458
2026-03-28 05:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5942ad7-b395-525b-8cf9-a58fcdd5027f with identifier: LL09458 to the API
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:43:21Z',
 'fuel_type': 'petrol',
 'id': 'b5942ad7-b395-525b-8cf9-a58fcdd5027f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL09458',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 124064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-24',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2017}
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-28 05:33:27 [auto1.de] INFO: Saving data for LL09458: {'auction_closing_time': 1774716201.0, 'created_time': 1774589451.804471, 'last_price_update_time': 1774676007.366112}
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL09458') HTTP/1.1" 204 0
2026-03-28 05:33:27 [auto1.de] INFO: Found listing with ID: NX06422
2026-03-28 05:33:27 [auto1.de] INFO: Found listing with ID: ZG25746
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG25746%27 HTTP/1.1" 200 None
2026-03-28 05:33:27 [auto1.de] INFO: Scrape type for ZG25746: 0
2026-03-28 05:33:27 [auto1.de] INFO: Found listing with ID: TA71788
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA71788%27 HTTP/1.1" 200 None
2026-03-28 05:33:27 [auto1.de] INFO: Scrape type for TA71788: 0
2026-03-28 05:33:27 [auto1.de] INFO: Found listing with ID: BY41560
2026-03-28 05:33:27 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-28 05:33:27 [auto1.de] INFO: Scrape type for LJ93781: 0
2026-03-28 05:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:28 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: MR54336
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for CG53828: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: VR71281
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR71281%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for VR71281: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: PB95910
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: YJ24873
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for RW72462: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: AP99471
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: FN87515
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN87515%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for FN87515: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: WX25953
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX25953%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for WX25953: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for EJ74150: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: RL49502
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL49502%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for RL49502: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: MK13186
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK13186%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for MK13186: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: PG02615
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: VR30275
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: GC30082
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: AH51648
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH51648%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for AH51648: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: SK62932
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: BM74248
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: WU59517
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for CC55438: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: ZD07127
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD07127%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for ZD07127: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: SR89138
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: HW40680
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW40680%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for HW40680: 0
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: JM30050
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: CJ89630
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-28 05:33:28 [auto1.de] INFO: Found listing with ID: BY97768
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY97768%27 HTTP/1.1" 200 None
2026-03-28 05:33:28 [auto1.de] INFO: Scrape type for BY97768: 2
2026-03-28 05:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb5ae32b-e028-5176-85b4-1d475a4fff7d with identifier: BY97768
2026-03-28 05:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb5ae32b-e028-5176-85b4-1d475a4fff7d with scrape type 2
2026-03-28 05:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb5ae32b-e028-5176-85b4-1d475a4fff7d with scrape type 2
2026-03-28 05:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb5ae32b-e028-5176-85b4-1d475a4fff7d, identifier: BY97768
2026-03-28 05:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb5ae32b-e028-5176-85b4-1d475a4fff7d with identifier: BY97768
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:33:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 05:33:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb5ae32b-e028-5176-85b4-1d475a4fff7d with identifier: BY97768
2026-03-28 05:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb5ae32b-e028-5176-85b4-1d475a4fff7d with identifier: BY97768 to the API
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:21:42Z',
 'fuel_type': 'gas',
 'id': 'cb5ae32b-e028-5176-85b4-1d475a4fff7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY97768',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 12585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-07',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2023}
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY97768%27 HTTP/1.1" 200 None
2026-03-28 05:33:29 [auto1.de] INFO: Saving data for BY97768: {'auction_closing_time': 1774714902.0, 'created_time': 1773132523.398025, 'last_price_update_time': 1774676009.350071}
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY97768') HTTP/1.1" 204 0
2026-03-28 05:33:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:29 [auto1.de] INFO: Found listing with ID: UB98859
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB98859%27 HTTP/1.1" 200 None
2026-03-28 05:33:29 [auto1.de] INFO: Scrape type for UB98859: 0
2026-03-28 05:33:29 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-28 05:33:29 [auto1.de] INFO: Scrape type for ZY22077: 2
2026-03-28 05:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with identifier: ZY22077
2026-03-28 05:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with scrape type 2
2026-03-28 05:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with scrape type 2
2026-03-28 05:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3db55283-45bc-58d5-8bb1-b7054fbb3b95, identifier: ZY22077
2026-03-28 05:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with identifier: ZY22077
2026-03-28 05:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with identifier: ZY22077
2026-03-28 05:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with identifier: ZY22077 to the API
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:28Z',
 'fuel_type': 'diesel',
 'id': '3db55283-45bc-58d5-8bb1-b7054fbb3b95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY22077',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 98938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-06',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang',
 'transmission': 'automatic',
 'trim': 'Comfortline lang',
 'year': 2018}
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-28 05:33:29 [auto1.de] INFO: Saving data for ZY22077: {'auction_closing_time': 1774714708.0, 'created_time': 1774552473.35878, 'last_price_update_time': 1774676009.910391}
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY22077') HTTP/1.1" 204 0
2026-03-28 05:33:29 [auto1.de] INFO: Found listing with ID: MY96813
2026-03-28 05:33:29 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-28 05:33:29 [auto1.de] INFO: Found listing with ID: NB75703
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB75703%27 HTTP/1.1" 200 None
2026-03-28 05:33:29 [auto1.de] INFO: Scrape type for NB75703: 0
2026-03-28 05:33:29 [auto1.de] INFO: Found listing with ID: RY65536
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65536%27 HTTP/1.1" 200 None
2026-03-28 05:33:29 [auto1.de] INFO: Scrape type for RY65536: 0
2026-03-28 05:33:29 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-28 05:33:29 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-28 05:33:29 [auto1.de] INFO: Scrape type for GU28360: 0
2026-03-28 05:33:29 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-28 05:33:29 [auto1.de] INFO: Found listing with ID: KC84563
2026-03-28 05:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:31 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for DN26053: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: RA53800
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: TK31423
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK31423%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for TK31423: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: CN66331
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN66331%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for CN66331: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: XR50139
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR50139%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for XR50139: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for GV67460: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: KT16474
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: GE45288
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: PP17491
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: JJ86337
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86337%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for JJ86337: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for XY94981: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: LD43960
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for TL90122: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: EW55752
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW55752%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for EW55752: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: DB79259
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: GA76856
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: KZ06018
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for JE00015: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: LC81158
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for LY63644: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: VY77073
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: ZK29969
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: RF30152
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF30152%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for RF30152: 0
2026-03-28 05:33:31 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-28 05:33:31 [auto1.de] INFO: Scrape type for PC09309: 2
2026-03-28 05:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e27a10-695c-5bc0-9bbf-6f380119c199 with identifier: PC09309
2026-03-28 05:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e27a10-695c-5bc0-9bbf-6f380119c199 with scrape type 2
2026-03-28 05:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68e27a10-695c-5bc0-9bbf-6f380119c199 with scrape type 2
2026-03-28 05:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68e27a10-695c-5bc0-9bbf-6f380119c199, identifier: PC09309
2026-03-28 05:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68e27a10-695c-5bc0-9bbf-6f380119c199 with identifier: PC09309
2026-03-28 05:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68e27a10-695c-5bc0-9bbf-6f380119c199 with identifier: PC09309
2026-03-28 05:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68e27a10-695c-5bc0-9bbf-6f380119c199 with identifier: PC09309 to the API
2026-03-28 05:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:31:37Z',
 'fuel_type': 'diesel',
 'id': '68e27a10-695c-5bc0-9bbf-6f380119c199',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC09309',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 94906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-25',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 05:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-28 05:33:32 [auto1.de] INFO: Saving data for PC09309: {'auction_closing_time': 1774715497.0, 'created_time': 1774550667.933043, 'last_price_update_time': 1774676012.879465}
2026-03-28 05:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC09309') HTTP/1.1" 204 0
2026-03-28 05:33:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:32 [auto1.de] INFO: Found listing with ID: ZS59678
2026-03-28 05:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS59678%27 HTTP/1.1" 200 None
2026-03-28 05:33:32 [auto1.de] INFO: Scrape type for ZS59678: 0
2026-03-28 05:33:32 [auto1.de] INFO: Found listing with ID: NC92529
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC92529%27 HTTP/1.1" 200 None
2026-03-28 05:33:33 [auto1.de] INFO: Scrape type for NC92529: 0
2026-03-28 05:33:33 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-28 05:33:33 [auto1.de] INFO: Found listing with ID: SC50732
2026-03-28 05:33:33 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-28 05:33:33 [auto1.de] INFO: Scrape type for VY07286: 2
2026-03-28 05:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with identifier: VY07286
2026-03-28 05:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with scrape type 2
2026-03-28 05:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with scrape type 2
2026-03-28 05:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca, identifier: VY07286
2026-03-28 05:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with identifier: VY07286
2026-03-28 05:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with identifier: VY07286
2026-03-28 05:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with identifier: VY07286 to the API
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:28:36Z',
 'fuel_type': 'petrol',
 'id': 'c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY07286',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 45780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-04',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2018}
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-28 05:33:33 [auto1.de] INFO: Saving data for VY07286: {'auction_closing_time': 1774715316.0, 'created_time': 1774552706.845603, 'last_price_update_time': 1774676013.426748}
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY07286') HTTP/1.1" 204 0
2026-03-28 05:33:33 [auto1.de] INFO: Found listing with ID: KP41876
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP41876%27 HTTP/1.1" 200 None
2026-03-28 05:33:33 [auto1.de] INFO: Scrape type for KP41876: 0
2026-03-28 05:33:33 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-28 05:33:33 [auto1.de] INFO: Scrape type for JD70113: 2
2026-03-28 05:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113
2026-03-28 05:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66a6e5e4-adf3-5cde-a18a-066d21844c1e with scrape type 2
2026-03-28 05:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66a6e5e4-adf3-5cde-a18a-066d21844c1e with scrape type 2
2026-03-28 05:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66a6e5e4-adf3-5cde-a18a-066d21844c1e, identifier: JD70113
2026-03-28 05:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113
2026-03-28 05:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113
2026-03-28 05:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113 to the API
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:55:36Z',
 'fuel_type': 'petrol',
 'id': '66a6e5e4-adf3-5cde-a18a-066d21844c1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD70113',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 148411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-27',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Nakama',
 'transmission': 'manual',
 'trim': 'Nakama',
 'year': 2016}
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-28 05:33:33 [auto1.de] INFO: Saving data for JD70113: {'auction_closing_time': 1774716936.0, 'created_time': 1774550433.961251, 'last_price_update_time': 1774676013.884407}
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD70113') HTTP/1.1" 204 0
2026-03-28 05:33:33 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-28 05:33:33 [auto1.de] INFO: Scrape type for FK64701: 2
2026-03-28 05:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9120448e-7eb1-56f0-a708-eb1845cc0385 with identifier: FK64701
2026-03-28 05:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9120448e-7eb1-56f0-a708-eb1845cc0385 with scrape type 2
2026-03-28 05:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9120448e-7eb1-56f0-a708-eb1845cc0385 with scrape type 2
2026-03-28 05:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9120448e-7eb1-56f0-a708-eb1845cc0385, identifier: FK64701
2026-03-28 05:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9120448e-7eb1-56f0-a708-eb1845cc0385 with identifier: FK64701
2026-03-28 05:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9120448e-7eb1-56f0-a708-eb1845cc0385 with identifier: FK64701
2026-03-28 05:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9120448e-7eb1-56f0-a708-eb1845cc0385 with identifier: FK64701 to the API
2026-03-28 05:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:15:46Z',
 'fuel_type': 'diesel',
 'id': '9120448e-7eb1-56f0-a708-eb1845cc0385',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK64701',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 74595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Kia Carens 1.7 CRDi Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2017}
2026-03-28 05:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-28 05:33:34 [auto1.de] INFO: Saving data for FK64701: {'auction_closing_time': 1774714546.0, 'created_time': 1774550470.262047, 'last_price_update_time': 1774676014.34911}
2026-03-28 05:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK64701') HTTP/1.1" 204 0
2026-03-28 05:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:35 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-28 05:33:35 [auto1.de] INFO: Scrape type for LM88961: 2
2026-03-28 05:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961
2026-03-28 05:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67eb503-4833-5bdc-bfbe-9159a5046b2d with scrape type 2
2026-03-28 05:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d67eb503-4833-5bdc-bfbe-9159a5046b2d with scrape type 2
2026-03-28 05:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d67eb503-4833-5bdc-bfbe-9159a5046b2d, identifier: LM88961
2026-03-28 05:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961
2026-03-28 05:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961
2026-03-28 05:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961 to the API
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:59:05Z',
 'fuel_type': 'petrol',
 'id': 'd67eb503-4833-5bdc-bfbe-9159a5046b2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM88961',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 159693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-26',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-28 05:33:35 [auto1.de] INFO: Saving data for LM88961: {'auction_closing_time': 1774717145.0, 'created_time': 1774552892.837492, 'last_price_update_time': 1774676015.757576}
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM88961') HTTP/1.1" 204 0
2026-03-28 05:33:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-28 05:33:35 [auto1.de] INFO: Scrape type for MA76308: 0
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: EF37274
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF37274%27 HTTP/1.1" 200 None
2026-03-28 05:33:35 [auto1.de] INFO: Scrape type for EF37274: 0
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: KR19080
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-28 05:33:35 [auto1.de] INFO: Scrape type for SD59172: 0
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: KG91640
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG91640%27 HTTP/1.1" 200 None
2026-03-28 05:33:35 [auto1.de] INFO: Scrape type for KG91640: 0
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: KM15369
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR18568%27 HTTP/1.1" 200 None
2026-03-28 05:33:35 [auto1.de] INFO: Scrape type for AR18568: 0
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: VA30007
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA30007%27 HTTP/1.1" 200 None
2026-03-28 05:33:35 [auto1.de] INFO: Scrape type for VA30007: 0
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: RG19344
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG19344%27 HTTP/1.1" 200 None
2026-03-28 05:33:35 [auto1.de] INFO: Scrape type for RG19344: 0
2026-03-28 05:33:35 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-28 05:33:35 [auto1.de] INFO: Scrape type for WK90635: 2
2026-03-28 05:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with identifier: WK90635
2026-03-28 05:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with scrape type 2
2026-03-28 05:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with scrape type 2
2026-03-28 05:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5efb68dd-d6d6-5adc-b262-c13fa8c07432, identifier: WK90635
2026-03-28 05:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with identifier: WK90635
2026-03-28 05:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with identifier: WK90635
2026-03-28 05:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with identifier: WK90635 to the API
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:39:05Z',
 'fuel_type': 'petrol',
 'id': '5efb68dd-d6d6-5adc-b262-c13fa8c07432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK90635',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 72090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-28',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2010}
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-28 05:33:36 [auto1.de] INFO: Saving data for WK90635: {'auction_closing_time': 1774715945.0, 'created_time': 1774552189.975449, 'last_price_update_time': 1774676016.302262}
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK90635') HTTP/1.1" 204 0
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: NZ71829
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-28 05:33:36 [auto1.de] INFO: Scrape type for HE99483: 0
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: YX52841
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-28 05:33:36 [auto1.de] INFO: Scrape type for GP94559: 0
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: AW04202
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: LS62630
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: GY70112
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY70112%27 HTTP/1.1" 200 None
2026-03-28 05:33:36 [auto1.de] INFO: Scrape type for GY70112: 0
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: LP56741
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP56741%27 HTTP/1.1" 200 None
2026-03-28 05:33:36 [auto1.de] INFO: Scrape type for LP56741: 2
2026-03-28 05:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 470be77d-8374-514e-8e37-1bc7e7c2af84 with identifier: LP56741
2026-03-28 05:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 470be77d-8374-514e-8e37-1bc7e7c2af84 with scrape type 2
2026-03-28 05:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 470be77d-8374-514e-8e37-1bc7e7c2af84 with scrape type 2
2026-03-28 05:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 470be77d-8374-514e-8e37-1bc7e7c2af84, identifier: LP56741
2026-03-28 05:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 470be77d-8374-514e-8e37-1bc7e7c2af84 with identifier: LP56741
2026-03-28 05:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 470be77d-8374-514e-8e37-1bc7e7c2af84 with identifier: LP56741
2026-03-28 05:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 470be77d-8374-514e-8e37-1bc7e7c2af84 with identifier: LP56741 to the API
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:06:10Z',
 'fuel_type': 'petrol',
 'id': '470be77d-8374-514e-8e37-1bc7e7c2af84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP56741',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 62105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-15',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP56741%27 HTTP/1.1" 200 None
2026-03-28 05:33:36 [auto1.de] INFO: Saving data for LP56741: {'auction_closing_time': 1774713970.0, 'created_time': 1774463639.248021, 'last_price_update_time': 1774676016.887753}
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP56741') HTTP/1.1" 204 0
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: HD75435
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: BG54710
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG54710%27 HTTP/1.1" 200 None
2026-03-28 05:33:36 [auto1.de] INFO: Scrape type for BG54710: 0
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-28 05:33:36 [auto1.de] INFO: Scrape type for LD06025: 0
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: YF10797
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF10797%27 HTTP/1.1" 200 None
2026-03-28 05:33:36 [auto1.de] INFO: Scrape type for YF10797: 0
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: ZK63444
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: VX88052
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX88052%27 HTTP/1.1" 200 None
2026-03-28 05:33:36 [auto1.de] INFO: Scrape type for VX88052: 0
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: KZ16739
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: EE36911
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: SS03319
2026-03-28 05:33:36 [auto1.de] INFO: Found listing with ID: YW70204
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW70204%27 HTTP/1.1" 200 None
2026-03-28 05:33:36 [auto1.de] INFO: Scrape type for YW70204: 0
2026-03-28 05:33:37 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-28 05:33:37 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-28 05:33:37 [auto1.de] INFO: Scrape type for AJ08508: 0
2026-03-28 05:33:37 [auto1.de] INFO: Found listing with ID: UH98030
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH98030%27 HTTP/1.1" 200 None
2026-03-28 05:33:37 [auto1.de] INFO: Scrape type for UH98030: 0
2026-03-28 05:33:37 [auto1.de] INFO: Found listing with ID: BS27408
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS27408%27 HTTP/1.1" 200 None
2026-03-28 05:33:37 [auto1.de] INFO: Scrape type for BS27408: 2
2026-03-28 05:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab6b63f0-6a7a-5a91-9b8e-1b5268ba7095 with identifier: BS27408
2026-03-28 05:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab6b63f0-6a7a-5a91-9b8e-1b5268ba7095 with scrape type 2
2026-03-28 05:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab6b63f0-6a7a-5a91-9b8e-1b5268ba7095 with scrape type 2
2026-03-28 05:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab6b63f0-6a7a-5a91-9b8e-1b5268ba7095, identifier: BS27408
2026-03-28 05:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab6b63f0-6a7a-5a91-9b8e-1b5268ba7095 with identifier: BS27408
2026-03-28 05:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab6b63f0-6a7a-5a91-9b8e-1b5268ba7095 with identifier: BS27408
2026-03-28 05:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab6b63f0-6a7a-5a91-9b8e-1b5268ba7095 with identifier: BS27408 to the API
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:06:50Z',
 'fuel_type': 'petrol',
 'id': 'ab6b63f0-6a7a-5a91-9b8e-1b5268ba7095',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS27408',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 217819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-08',
 'seller_name': None,
 'title': 'Porsche Cayenne S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS27408%27 HTTP/1.1" 200 None
2026-03-28 05:33:37 [auto1.de] INFO: Saving data for BS27408: {'auction_closing_time': 1774714010.0, 'created_time': 1774463585.631046, 'last_price_update_time': 1774676017.46447}
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS27408') HTTP/1.1" 204 0
2026-03-28 05:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:38 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: VX44094
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: XV69460
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV69460%27 HTTP/1.1" 200 None
2026-03-28 05:33:38 [auto1.de] INFO: Scrape type for XV69460: 0
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: LW52263
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW52263%27 HTTP/1.1" 200 None
2026-03-28 05:33:38 [auto1.de] INFO: Scrape type for LW52263: 0
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: ER58682
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: CV14435
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-28 05:33:38 [auto1.de] INFO: Scrape type for WW27642: 0
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: BZ25882
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: DA66634
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA66634%27 HTTP/1.1" 200 None
2026-03-28 05:33:38 [auto1.de] INFO: Scrape type for DA66634: 0
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: LK13966
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: UM70587
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: UM02167
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-28 05:33:38 [auto1.de] INFO: Scrape type for BN03285: 0
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: SX00358
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: FT33295
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: HC21911
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: RX96869
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-28 05:33:38 [auto1.de] INFO: Found listing with ID: PB88478
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB88478%27 HTTP/1.1" 200 None
2026-03-28 05:33:38 [auto1.de] INFO: Scrape type for PB88478: 2
2026-03-28 05:33:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae03e499-c3c0-5846-a5f4-719f156513d7 with identifier: PB88478
2026-03-28 05:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae03e499-c3c0-5846-a5f4-719f156513d7 with scrape type 2
2026-03-28 05:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae03e499-c3c0-5846-a5f4-719f156513d7 with scrape type 2
2026-03-28 05:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae03e499-c3c0-5846-a5f4-719f156513d7, identifier: PB88478
2026-03-28 05:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae03e499-c3c0-5846-a5f4-719f156513d7 with identifier: PB88478
2026-03-28 05:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae03e499-c3c0-5846-a5f4-719f156513d7 with identifier: PB88478
2026-03-28 05:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae03e499-c3c0-5846-a5f4-719f156513d7 with identifier: PB88478 to the API
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:10:28Z',
 'fuel_type': 'diesel',
 'id': 'ae03e499-c3c0-5846-a5f4-719f156513d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB88478',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 50646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-16',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi EcoBlue L1 Titanium X',
 'transmission': 'automatic',
 'trim': 'L1 Titanium X',
 'year': 2022}
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB88478%27 HTTP/1.1" 200 None
2026-03-28 05:33:38 [auto1.de] INFO: Saving data for PB88478: {'auction_closing_time': 1774714228.0, 'created_time': 1774463460.719882, 'last_price_update_time': 1774676018.901853}
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB88478') HTTP/1.1" 204 0
2026-03-28 05:33:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:39 [auto1.de] INFO: Found listing with ID: UU13663
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU13663%27 HTTP/1.1" 200 None
2026-03-28 05:33:39 [auto1.de] INFO: Scrape type for UU13663: 2
2026-03-28 05:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a54a79b-520f-5140-b51e-a60c696b951f with identifier: UU13663
2026-03-28 05:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a54a79b-520f-5140-b51e-a60c696b951f with scrape type 2
2026-03-28 05:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a54a79b-520f-5140-b51e-a60c696b951f with scrape type 2
2026-03-28 05:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a54a79b-520f-5140-b51e-a60c696b951f, identifier: UU13663
2026-03-28 05:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a54a79b-520f-5140-b51e-a60c696b951f with identifier: UU13663
2026-03-28 05:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a54a79b-520f-5140-b51e-a60c696b951f with identifier: UU13663
2026-03-28 05:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a54a79b-520f-5140-b51e-a60c696b951f with identifier: UU13663 to the API
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:18:16Z',
 'fuel_type': 'diesel',
 'id': '5a54a79b-520f-5140-b51e-a60c696b951f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU13663',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 277870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-09',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Summum AWD',
 'transmission': 'manual',
 'trim': 'Summum AWD',
 'year': 2014}
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU13663%27 HTTP/1.1" 200 None
2026-03-28 05:33:39 [auto1.de] INFO: Saving data for UU13663: {'auction_closing_time': 1774714696.0, 'created_time': 1774463622.322746, 'last_price_update_time': 1774676019.450278}
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU13663') HTTP/1.1" 204 0
2026-03-28 05:33:39 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-28 05:33:39 [auto1.de] INFO: Found listing with ID: WA83866
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA83866%27 HTTP/1.1" 200 None
2026-03-28 05:33:39 [auto1.de] INFO: Scrape type for WA83866: 0
2026-03-28 05:33:39 [auto1.de] INFO: Found listing with ID: HH92077
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH92077%27 HTTP/1.1" 200 None
2026-03-28 05:33:39 [auto1.de] INFO: Scrape type for HH92077: 0
2026-03-28 05:33:39 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-28 05:33:39 [auto1.de] INFO: Scrape type for SB35470: 0
2026-03-28 05:33:39 [auto1.de] INFO: Found listing with ID: YW60751
2026-03-28 05:33:39 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20956%27 HTTP/1.1" 200 None
2026-03-28 05:33:39 [auto1.de] INFO: Scrape type for SK20956: 0
2026-03-28 05:33:39 [auto1.de] INFO: Found listing with ID: YX62865
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX62865%27 HTTP/1.1" 200 None
2026-03-28 05:33:39 [auto1.de] INFO: Scrape type for YX62865: 2
2026-03-28 05:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 102d5c3a-039e-5388-aa16-1a329b1efd8b with identifier: YX62865
2026-03-28 05:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 102d5c3a-039e-5388-aa16-1a329b1efd8b with scrape type 2
2026-03-28 05:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 102d5c3a-039e-5388-aa16-1a329b1efd8b with scrape type 2
2026-03-28 05:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 102d5c3a-039e-5388-aa16-1a329b1efd8b, identifier: YX62865
2026-03-28 05:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 102d5c3a-039e-5388-aa16-1a329b1efd8b with identifier: YX62865
2026-03-28 05:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 102d5c3a-039e-5388-aa16-1a329b1efd8b with identifier: YX62865
2026-03-28 05:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 102d5c3a-039e-5388-aa16-1a329b1efd8b with identifier: YX62865 to the API
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:08:05Z',
 'fuel_type': 'diesel',
 'id': '102d5c3a-039e-5388-aa16-1a329b1efd8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX62865',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 111693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2018}
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX62865%27 HTTP/1.1" 200 None
2026-03-28 05:33:39 [auto1.de] INFO: Saving data for YX62865: {'auction_closing_time': 1774714085.0, 'created_time': 1774463723.51128, 'last_price_update_time': 1774676019.958092}
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX62865') HTTP/1.1" 204 0
2026-03-28 05:33:39 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-28 05:33:39 [auto1.de] INFO: Found listing with ID: ZZ55407
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ55407%27 HTTP/1.1" 200 None
2026-03-28 05:33:39 [auto1.de] INFO: Scrape type for ZZ55407: 2
2026-03-28 05:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dba76ca-d9b9-5ed3-924c-b5817ec1fdcf with identifier: ZZ55407
2026-03-28 05:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dba76ca-d9b9-5ed3-924c-b5817ec1fdcf with scrape type 2
2026-03-28 05:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dba76ca-d9b9-5ed3-924c-b5817ec1fdcf with scrape type 2
2026-03-28 05:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dba76ca-d9b9-5ed3-924c-b5817ec1fdcf, identifier: ZZ55407
2026-03-28 05:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dba76ca-d9b9-5ed3-924c-b5817ec1fdcf with identifier: ZZ55407
2026-03-28 05:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dba76ca-d9b9-5ed3-924c-b5817ec1fdcf with identifier: ZZ55407
2026-03-28 05:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dba76ca-d9b9-5ed3-924c-b5817ec1fdcf with identifier: ZZ55407 to the API
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:21:29Z',
 'fuel_type': 'petrol',
 'id': '2dba76ca-d9b9-5ed3-924c-b5817ec1fdcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ55407',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 40672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2022}
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ55407%27 HTTP/1.1" 200 None
2026-03-28 05:33:40 [auto1.de] INFO: Saving data for ZZ55407: {'auction_closing_time': 1774714889.0, 'created_time': 1774552645.294037, 'last_price_update_time': 1774676020.428681}
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ55407') HTTP/1.1" 204 0
2026-03-28 05:33:40 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-28 05:33:40 [auto1.de] INFO: Found listing with ID: JL97889
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL97889%27 HTTP/1.1" 200 None
2026-03-28 05:33:40 [auto1.de] INFO: Scrape type for JL97889: 0
2026-03-28 05:33:40 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-28 05:33:40 [auto1.de] INFO: Found listing with ID: YU02845
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU02845%27 HTTP/1.1" 200 None
2026-03-28 05:33:40 [auto1.de] INFO: Scrape type for YU02845: 0
2026-03-28 05:33:40 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-28 05:33:40 [auto1.de] INFO: Scrape type for CP99772: 2
2026-03-28 05:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772
2026-03-28 05:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with scrape type 2
2026-03-28 05:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with scrape type 2
2026-03-28 05:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c, identifier: CP99772
2026-03-28 05:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772
2026-03-28 05:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772
2026-03-28 05:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772 to the API
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:55:12Z',
 'fuel_type': 'petrol',
 'id': '6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP99772',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 88770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-11',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-28 05:33:40 [auto1.de] INFO: Saving data for CP99772: {'auction_closing_time': 1774716912.0, 'created_time': 1774552784.53474, 'last_price_update_time': 1774676020.900935}
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP99772') HTTP/1.1" 204 0
2026-03-28 05:33:41 [auto1.de] INFO: Found listing with ID: WR22738
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR22738%27 HTTP/1.1" 200 None
2026-03-28 05:33:41 [auto1.de] INFO: Scrape type for WR22738: 0
2026-03-28 05:33:41 [auto1.de] INFO: Found listing with ID: GP74205
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP74205%27 HTTP/1.1" 200 None
2026-03-28 05:33:41 [auto1.de] INFO: Scrape type for GP74205: 0
2026-03-28 05:33:41 [auto1.de] INFO: Found listing with ID: VM58526
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM58526%27 HTTP/1.1" 200 None
2026-03-28 05:33:41 [auto1.de] INFO: Scrape type for VM58526: 2
2026-03-28 05:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with identifier: VM58526
2026-03-28 05:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with scrape type 2
2026-03-28 05:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with scrape type 2
2026-03-28 05:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b41ea3c-ccd0-53f4-8814-96787e7629c5, identifier: VM58526
2026-03-28 05:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with identifier: VM58526
2026-03-28 05:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with identifier: VM58526
2026-03-28 05:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b41ea3c-ccd0-53f4-8814-96787e7629c5 with identifier: VM58526 to the API
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:13:35Z',
 'fuel_type': 'petrol',
 'id': '2b41ea3c-ccd0-53f4-8814-96787e7629c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM58526',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 141194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-26',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Drive',
 'transmission': 'automatic',
 'trim': 'Drive',
 'year': 2017}
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM58526%27 HTTP/1.1" 200 None
2026-03-28 05:33:41 [auto1.de] INFO: Saving data for VM58526: {'auction_closing_time': 1774714415.0, 'created_time': 1773135539.578931, 'last_price_update_time': 1774676021.477472}
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM58526') HTTP/1.1" 204 0
2026-03-28 05:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:41 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:41 [auto1.de] INFO: Found listing with ID: BB20772
2026-03-28 05:33:41 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-28 05:33:41 [auto1.de] INFO: Scrape type for AN54197: 2
2026-03-28 05:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197
2026-03-28 05:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31358549-8be4-5779-90bf-bb86c234c591 with scrape type 2
2026-03-28 05:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31358549-8be4-5779-90bf-bb86c234c591 with scrape type 2
2026-03-28 05:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31358549-8be4-5779-90bf-bb86c234c591, identifier: AN54197
2026-03-28 05:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197
2026-03-28 05:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197
2026-03-28 05:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197 to the API
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-28T16:59:02Z',
 'fuel_type': 'petrol',
 'id': '31358549-8be4-5779-90bf-bb86c234c591',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN54197',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 4',
 'odometer': 120286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': None,
 'title': 'Audi RS 4 2.9 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Saving data for AN54197: {'auction_closing_time': 1774717142.0, 'created_time': 1773223317.122125, 'last_price_update_time': 1774676022.270214}
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN54197') HTTP/1.1" 204 0
2026-03-28 05:33:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: VM18539
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM18539%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for VM18539: 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: XS27147
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: EC94378
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG33917%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for KG33917: 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for SR59541: 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: XH17587
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for GC49390: 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: LV13893
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: CE86831
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE86831%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for CE86831: 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for WV53584: 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: TW48266
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: VD19209
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: LB34489
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for LK66468: 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: TR39575
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR39575%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for TR39575: 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: KN16725
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN16725%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for KN16725: 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: VG22858
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: ZK19786
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK19786%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for ZK19786: 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: SA90137
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA90137%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for SA90137: 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: JM85963
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: EW45766
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Scrape type for WH66881: 2
2026-03-28 05:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with identifier: WH66881
2026-03-28 05:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with scrape type 2
2026-03-28 05:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with scrape type 2
2026-03-28 05:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603, identifier: WH66881
2026-03-28 05:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with identifier: WH66881
2026-03-28 05:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with identifier: WH66881
2026-03-28 05:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with identifier: WH66881 to the API
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:02Z',
 'fuel_type': 'diesel',
 'id': '41e51b4a-ef9c-5f3e-b1d8-e91ce3061603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH66881',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 169846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2016}
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-28 05:33:42 [auto1.de] INFO: Saving data for WH66881: {'auction_closing_time': 1774714622.0, 'created_time': 1774552822.593512, 'last_price_update_time': 1774676022.882549}
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH66881') HTTP/1.1" 204 0
2026-03-28 05:33:42 [auto1.de] INFO: Found listing with ID: LC48893
2026-03-28 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC48893%27 HTTP/1.1" 200 None
2026-03-28 05:33:43 [auto1.de] INFO: Scrape type for LC48893: 0
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: SD14498
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD14498%27 HTTP/1.1" 200 None
2026-03-28 05:33:43 [auto1.de] INFO: Scrape type for SD14498: 0
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: KP50687
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP50687%27 HTTP/1.1" 200 None
2026-03-28 05:33:43 [auto1.de] INFO: Scrape type for KP50687: 0
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: LS78763
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: AR17356
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: NS95449
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: SP79690
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: JP42070
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-28 05:33:43 [auto1.de] INFO: Scrape type for UC38867: 2
2026-03-28 05:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867
2026-03-28 05:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0bd1214-59f8-57e2-a2df-20914b0eb727 with scrape type 2
2026-03-28 05:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0bd1214-59f8-57e2-a2df-20914b0eb727 with scrape type 2
2026-03-28 05:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0bd1214-59f8-57e2-a2df-20914b0eb727, identifier: UC38867
2026-03-28 05:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867
2026-03-28 05:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867
2026-03-28 05:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867 to the API
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:47:46Z',
 'fuel_type': 'petrol',
 'id': 'f0bd1214-59f8-57e2-a2df-20914b0eb727',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC38867',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 30640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-26',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2017}
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-28 05:33:43 [auto1.de] INFO: Saving data for UC38867: {'auction_closing_time': 1774716466.0, 'created_time': 1774552144.218025, 'last_price_update_time': 1774676023.453051}
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC38867') HTTP/1.1" 204 0
2026-03-28 05:33:43 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-28 05:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:44 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: BN99234
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99234%27 HTTP/1.1" 200 None
2026-03-28 05:33:44 [auto1.de] INFO: Scrape type for BN99234: 0
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-28 05:33:44 [auto1.de] INFO: Scrape type for ND35935: 0
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: AY72100
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY72100%27 HTTP/1.1" 200 None
2026-03-28 05:33:44 [auto1.de] INFO: Scrape type for AY72100: 0
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: ZA57423
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA57423%27 HTTP/1.1" 200 None
2026-03-28 05:33:44 [auto1.de] INFO: Scrape type for ZA57423: 0
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: JB09111
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: PG10773
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: UH76939
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: TB55378
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF11378%27 HTTP/1.1" 200 None
2026-03-28 05:33:44 [auto1.de] INFO: Scrape type for FF11378: 0
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: AP01052
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: UF45405
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45405%27 HTTP/1.1" 200 None
2026-03-28 05:33:44 [auto1.de] INFO: Scrape type for UF45405: 0
2026-03-28 05:33:44 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-28 05:33:44 [auto1.de] INFO: Scrape type for WS02487: 2
2026-03-28 05:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ebf2e54-c571-56db-afed-9b73305e8042 with identifier: WS02487
2026-03-28 05:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ebf2e54-c571-56db-afed-9b73305e8042 with scrape type 2
2026-03-28 05:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ebf2e54-c571-56db-afed-9b73305e8042 with scrape type 2
2026-03-28 05:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ebf2e54-c571-56db-afed-9b73305e8042, identifier: WS02487
2026-03-28 05:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ebf2e54-c571-56db-afed-9b73305e8042 with identifier: WS02487
2026-03-28 05:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ebf2e54-c571-56db-afed-9b73305e8042 with identifier: WS02487
2026-03-28 05:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ebf2e54-c571-56db-afed-9b73305e8042 with identifier: WS02487 to the API
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-28T16:25:31Z',
 'fuel_type': 'petrol',
 'id': '2ebf2e54-c571-56db-afed-9b73305e8042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS02487',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 80912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2020}
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-28 05:33:45 [auto1.de] INFO: Saving data for WS02487: {'auction_closing_time': 1774715131.0, 'created_time': 1774552594.082161, 'last_price_update_time': 1774676025.287816}
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS02487') HTTP/1.1" 204 0
2026-03-28 05:33:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: XR03491
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-28 05:33:45 [auto1.de] INFO: Scrape type for MA63217: 0
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-28 05:33:45 [auto1.de] INFO: Scrape type for XM77164: 2
2026-03-28 05:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ca21b18-13fc-5399-80e6-9350d36fa963 with identifier: XM77164
2026-03-28 05:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ca21b18-13fc-5399-80e6-9350d36fa963 with scrape type 2
2026-03-28 05:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ca21b18-13fc-5399-80e6-9350d36fa963 with scrape type 2
2026-03-28 05:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ca21b18-13fc-5399-80e6-9350d36fa963, identifier: XM77164
2026-03-28 05:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ca21b18-13fc-5399-80e6-9350d36fa963 with identifier: XM77164
2026-03-28 05:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ca21b18-13fc-5399-80e6-9350d36fa963 with identifier: XM77164
2026-03-28 05:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ca21b18-13fc-5399-80e6-9350d36fa963 with identifier: XM77164 to the API
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:23:21Z',
 'fuel_type': 'petrol',
 'id': '0ca21b18-13fc-5399-80e6-9350d36fa963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM77164',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 96283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2016}
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-28 05:33:45 [auto1.de] INFO: Saving data for XM77164: {'auction_closing_time': 1774715001.0, 'created_time': 1774550441.558277, 'last_price_update_time': 1774676025.83522}
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM77164') HTTP/1.1" 204 0
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-28 05:33:45 [auto1.de] INFO: Scrape type for HH56316: 0
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: UE89498
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE89498%27 HTTP/1.1" 200 None
2026-03-28 05:33:45 [auto1.de] INFO: Scrape type for UE89498: 0
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-28 05:33:45 [auto1.de] INFO: Scrape type for JF78286: 0
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: JP65265
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: ET53588
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: NP60172
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: TT75700
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: JP09068
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP09068%27 HTTP/1.1" 200 None
2026-03-28 05:33:45 [auto1.de] INFO: Scrape type for JP09068: 0
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: BN35753
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN35753%27 HTTP/1.1" 200 None
2026-03-28 05:33:45 [auto1.de] INFO: Scrape type for BN35753: 0
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: SU92551
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92551%27 HTTP/1.1" 200 None
2026-03-28 05:33:45 [auto1.de] INFO: Scrape type for SU92551: 0
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: EG23428
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG23428%27 HTTP/1.1" 200 None
2026-03-28 05:33:45 [auto1.de] INFO: Scrape type for EG23428: 0
2026-03-28 05:33:45 [auto1.de] INFO: Found listing with ID: JG98331
2026-03-28 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG98331%27 HTTP/1.1" 200 None
2026-03-28 05:33:46 [auto1.de] INFO: Scrape type for JG98331: 0
2026-03-28 05:33:46 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-28 05:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:47 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for SW44796: 2
2026-03-28 05:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with identifier: SW44796
2026-03-28 05:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with scrape type 2
2026-03-28 05:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with scrape type 2
2026-03-28 05:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d3db507-9b97-5ab8-b17a-5d6f98c2255d, identifier: SW44796
2026-03-28 05:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with identifier: SW44796
2026-03-28 05:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with identifier: SW44796
2026-03-28 05:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with identifier: SW44796 to the API
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-28T16:37:37Z',
 'fuel_type': 'petrol',
 'id': '5d3db507-9b97-5ab8-b17a-5d6f98c2255d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW44796',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 70844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-18',
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 Skyactiv-X Mild-Hybrid Selection AWD',
 'transmission': 'automatic',
 'trim': 'Selection AWD',
 'year': 2020}
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Saving data for SW44796: {'auction_closing_time': 1774715857.0, 'created_time': 1774552735.826005, 'last_price_update_time': 1774676027.521506}
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW44796') HTTP/1.1" 204 0
2026-03-28 05:33:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: DZ63993
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63993%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for DZ63993: 0
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: AV28159
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV28159%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for AV28159: 0
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: DH11736
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH11736%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for DH11736: 0
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: HB39069
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB39069%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for HB39069: 0
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: FH49394
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH49394%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for FH49394: 0
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: EY31164
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: DM27402
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: VH72276
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH72276%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for VH72276: 0
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: EF16593
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: DC86384
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: XL03429
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: ME80175
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: LJ19691
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ19691%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for LJ19691: 0
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: UK33318
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK33318%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for UK33318: 0
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: GD09618
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: LU10384
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU10384%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for LU10384: 0
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: SW55555
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW55555%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for SW55555: 0
2026-03-28 05:33:47 [auto1.de] INFO: Found listing with ID: DX64051
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX64051%27 HTTP/1.1" 200 None
2026-03-28 05:33:47 [auto1.de] INFO: Scrape type for DX64051: 2
2026-03-28 05:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e389707a-ab32-5dfa-928c-d6fb886e17b4 with identifier: DX64051
2026-03-28 05:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e389707a-ab32-5dfa-928c-d6fb886e17b4 with scrape type 2
2026-03-28 05:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e389707a-ab32-5dfa-928c-d6fb886e17b4 with scrape type 2
2026-03-28 05:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e389707a-ab32-5dfa-928c-d6fb886e17b4, identifier: DX64051
2026-03-28 05:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e389707a-ab32-5dfa-928c-d6fb886e17b4 with identifier: DX64051
2026-03-28 05:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e389707a-ab32-5dfa-928c-d6fb886e17b4 with identifier: DX64051
2026-03-28 05:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e389707a-ab32-5dfa-928c-d6fb886e17b4 with identifier: DX64051 to the API
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:45:16Z',
 'fuel_type': 'petrol',
 'id': 'e389707a-ab32-5dfa-928c-d6fb886e17b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX64051',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 111890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-08',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX64051%27 HTTP/1.1" 200 None
2026-03-28 05:33:48 [auto1.de] INFO: Saving data for DX64051: {'auction_closing_time': 1774716316.0, 'created_time': 1773226291.429636, 'last_price_update_time': 1774676028.377258}
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX64051') HTTP/1.1" 204 0
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-28 05:33:48 [auto1.de] INFO: Scrape type for KY27003: 0
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: GC11554
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11554%27 HTTP/1.1" 200 None
2026-03-28 05:33:48 [auto1.de] INFO: Scrape type for GC11554: 0
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: DG73763
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: DM75800
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: LK91672
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK91672%27 HTTP/1.1" 200 None
2026-03-28 05:33:48 [auto1.de] INFO: Scrape type for LK91672: 0
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: DM27876
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27876%27 HTTP/1.1" 200 None
2026-03-28 05:33:48 [auto1.de] INFO: Scrape type for DM27876: 0
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-28 05:33:48 [auto1.de] INFO: Scrape type for YJ03455: 0
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: JV13466
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV13466%27 HTTP/1.1" 200 None
2026-03-28 05:33:48 [auto1.de] INFO: Scrape type for JV13466: 0
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: CA25135
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA25135%27 HTTP/1.1" 200 None
2026-03-28 05:33:48 [auto1.de] INFO: Scrape type for CA25135: 0
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: XJ03116
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: GJ22872
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: LY83688
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG31591%27 HTTP/1.1" 200 None
2026-03-28 05:33:48 [auto1.de] INFO: Scrape type for RG31591: 0
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: AU11749
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU11749%27 HTTP/1.1" 200 None
2026-03-28 05:33:48 [auto1.de] INFO: Scrape type for AU11749: 0
2026-03-28 05:33:48 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-28 05:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:49 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:49 [auto1.de] INFO: Found listing with ID: BP97847
2026-03-28 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97847%27 HTTP/1.1" 200 None
2026-03-28 05:33:49 [auto1.de] INFO: Scrape type for BP97847: 0
2026-03-28 05:33:49 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-28 05:33:49 [auto1.de] INFO: Found listing with ID: UU08337
2026-03-28 05:33:49 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-28 05:33:49 [auto1.de] INFO: Found listing with ID: AW77677
2026-03-28 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW77677%27 HTTP/1.1" 200 None
2026-03-28 05:33:49 [auto1.de] INFO: Scrape type for AW77677: 0
2026-03-28 05:33:49 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-28 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-28 05:33:49 [auto1.de] INFO: Scrape type for JR17780: 2
2026-03-28 05:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780
2026-03-28 05:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with scrape type 2
2026-03-28 05:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with scrape type 2
2026-03-28 05:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc, identifier: JR17780
2026-03-28 05:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780
2026-03-28 05:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780
2026-03-28 05:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780 to the API
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:48:31Z',
 'fuel_type': 'petrol',
 'id': '68c9a3cd-3f7d-5323-94bf-c8e96811cdbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR17780',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 129260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-11',
 'seller_name': None,
 'title': 'BMW 3er 320Ci',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Saving data for JR17780: {'auction_closing_time': 1774716511.0, 'created_time': 1774552907.746601, 'last_price_update_time': 1774676030.283024}
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR17780') HTTP/1.1" 204 0
2026-03-28 05:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55553%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Scrape type for PJ55553: 0
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: JS18572
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS18572%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Scrape type for JS18572: 0
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: JD92059
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD92059%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Scrape type for JD92059: 0
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: KF61768
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF61768%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Scrape type for KF61768: 0
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: BU22697
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: KX87155
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: BC57844
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: LC58523
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC58523%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Scrape type for LC58523: 0
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Scrape type for AW08292: 2
2026-03-28 05:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292
2026-03-28 05:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with scrape type 2
2026-03-28 05:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with scrape type 2
2026-03-28 05:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074, identifier: AW08292
2026-03-28 05:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292
2026-03-28 05:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292
2026-03-28 05:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292 to the API
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:42:54Z',
 'fuel_type': 'diesel',
 'id': '3d56433f-ccf3-56e8-97fc-ee5a95ef3074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW08292',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 244577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Life 4Motion BlueMotion Tech',
 'year': 2013}
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Saving data for AW08292: {'auction_closing_time': 1774716174.0, 'created_time': 1774589448.774175, 'last_price_update_time': 1774676030.893927}
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW08292') HTTP/1.1" 204 0
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: UN81742
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN81742%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Scrape type for UN81742: 0
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Scrape type for FR19321: 0
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: MN62628
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: ZH11790
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: AB79624
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB79624%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Scrape type for AB79624: 0
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: XE56865
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE11389%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Scrape type for WE11389: 0
2026-03-28 05:33:50 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-28 05:33:50 [auto1.de] INFO: Scrape type for DS69815: 2
2026-03-28 05:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815
2026-03-28 05:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with scrape type 2
2026-03-28 05:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with scrape type 2
2026-03-28 05:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 768d5fd6-295d-5f44-9d3a-f2841abe95e3, identifier: DS69815
2026-03-28 05:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815
2026-03-28 05:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815
2026-03-28 05:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815 to the API
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 525,
 'expiration_date': '2026-03-28T16:59:51Z',
 'fuel_type': 'petrol',
 'id': '768d5fd6-295d-5f44-9d3a-f2841abe95e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS69815',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 94482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-11',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 5.0 V8 Kompressor Autobiography '
          'Dynamic',
 'transmission': 'automatic',
 'trim': 'Autobiography Dynamic',
 'year': 2019}
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-28 05:33:51 [auto1.de] INFO: Saving data for DS69815: {'auction_closing_time': 1774717191.0, 'created_time': 1774550472.546837, 'last_price_update_time': 1774676031.421995}
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS69815') HTTP/1.1" 204 0
2026-03-28 05:33:51 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-28 05:33:51 [auto1.de] INFO: Found listing with ID: VC92798
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC92798%27 HTTP/1.1" 200 None
2026-03-28 05:33:51 [auto1.de] INFO: Scrape type for VC92798: 0
2026-03-28 05:33:51 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-28 05:33:51 [auto1.de] INFO: Scrape type for FH94786: 2
2026-03-28 05:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786
2026-03-28 05:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31706614-c4a9-57f0-8950-068b251b4247 with scrape type 2
2026-03-28 05:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31706614-c4a9-57f0-8950-068b251b4247 with scrape type 2
2026-03-28 05:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31706614-c4a9-57f0-8950-068b251b4247, identifier: FH94786
2026-03-28 05:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786
2026-03-28 05:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786
2026-03-28 05:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786 to the API
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:47:10Z',
 'fuel_type': 'diesel',
 'id': '31706614-c4a9-57f0-8950-068b251b4247',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH94786',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 88716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2015}
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-28 05:33:51 [auto1.de] INFO: Saving data for FH94786: {'auction_closing_time': 1774716430.0, 'created_time': 1773945700.262138, 'last_price_update_time': 1774676031.966721}
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH94786') HTTP/1.1" 204 0
2026-03-28 05:33:51 [auto1.de] INFO: Found listing with ID: JZ81394
2026-03-28 05:33:51 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-28 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-28 05:33:52 [auto1.de] INFO: Scrape type for UH78050: 2
2026-03-28 05:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86d7f31d-6269-59aa-978b-a4a75741fb08 with identifier: UH78050
2026-03-28 05:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86d7f31d-6269-59aa-978b-a4a75741fb08 with scrape type 2
2026-03-28 05:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86d7f31d-6269-59aa-978b-a4a75741fb08 with scrape type 2
2026-03-28 05:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86d7f31d-6269-59aa-978b-a4a75741fb08, identifier: UH78050
2026-03-28 05:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86d7f31d-6269-59aa-978b-a4a75741fb08 with identifier: UH78050
2026-03-28 05:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86d7f31d-6269-59aa-978b-a4a75741fb08 with identifier: UH78050
2026-03-28 05:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86d7f31d-6269-59aa-978b-a4a75741fb08 with identifier: UH78050 to the API
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:22:36Z',
 'fuel_type': 'diesel',
 'id': '86d7f31d-6269-59aa-978b-a4a75741fb08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH78050',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 139149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2020}
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-28 05:33:52 [auto1.de] INFO: Saving data for UH78050: {'auction_closing_time': 1774714956.0, 'created_time': 1774552830.799241, 'last_price_update_time': 1774676032.413786}
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH78050') HTTP/1.1" 204 0
2026-03-28 05:33:52 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-28 05:33:52 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-28 05:33:52 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-28 05:33:52 [auto1.de] INFO: Scrape type for WT92712: 2
2026-03-28 05:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2105802f-56d9-5452-bcf1-7b16a03d5338 with identifier: WT92712
2026-03-28 05:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2105802f-56d9-5452-bcf1-7b16a03d5338 with scrape type 2
2026-03-28 05:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2105802f-56d9-5452-bcf1-7b16a03d5338 with scrape type 2
2026-03-28 05:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2105802f-56d9-5452-bcf1-7b16a03d5338, identifier: WT92712
2026-03-28 05:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2105802f-56d9-5452-bcf1-7b16a03d5338 with identifier: WT92712
2026-03-28 05:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2105802f-56d9-5452-bcf1-7b16a03d5338 with identifier: WT92712
2026-03-28 05:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2105802f-56d9-5452-bcf1-7b16a03d5338 with identifier: WT92712 to the API
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:08:47Z',
 'fuel_type': 'petrol',
 'id': '2105802f-56d9-5452-bcf1-7b16a03d5338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT92712',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 185851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-20',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Prestige 4x4',
 'transmission': 'manual',
 'trim': 'Prestige 4x4',
 'year': 2015}
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-28 05:33:52 [auto1.de] INFO: Saving data for WT92712: {'auction_closing_time': 1774714127.0, 'created_time': 1774551210.541408, 'last_price_update_time': 1774676032.879713}
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT92712') HTTP/1.1" 204 0
2026-03-28 05:33:52 [auto1.de] INFO: Found listing with ID: YN46054
2026-03-28 05:33:52 [auto1.de] INFO: Found listing with ID: ZA81194
2026-03-28 05:33:52 [auto1.de] INFO: Found listing with ID: PL31001
2026-03-28 05:33:52 [auto1.de] INFO: Found listing with ID: RU30790
2026-03-28 05:33:52 [auto1.de] INFO: Found listing with ID: XF49404
2026-03-28 05:33:52 [auto1.de] INFO: Found listing with ID: SK57616
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK57616%27 HTTP/1.1" 200 None
2026-03-28 05:33:52 [auto1.de] INFO: Scrape type for SK57616: 0
2026-03-28 05:33:52 [auto1.de] INFO: Found listing with ID: FH08441
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH08441%27 HTTP/1.1" 200 None
2026-03-28 05:33:52 [auto1.de] INFO: Scrape type for FH08441: 0
2026-03-28 05:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:53 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: PB92040
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: MV92470
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: VW23219
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: TN75370
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN75370%27 HTTP/1.1" 200 None
2026-03-28 05:33:53 [auto1.de] INFO: Scrape type for TN75370: 0
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: GD02495
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02495%27 HTTP/1.1" 200 None
2026-03-28 05:33:53 [auto1.de] INFO: Scrape type for GD02495: 0
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: ZR68100
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR68100%27 HTTP/1.1" 200 None
2026-03-28 05:33:53 [auto1.de] INFO: Scrape type for ZR68100: 0
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV16310%27 HTTP/1.1" 200 None
2026-03-28 05:33:53 [auto1.de] INFO: Scrape type for EV16310: 0
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: YZ46630
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ46630%27 HTTP/1.1" 200 None
2026-03-28 05:33:53 [auto1.de] INFO: Scrape type for YZ46630: 0
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: ZU43867
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: BL06566
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL06566%27 HTTP/1.1" 200 None
2026-03-28 05:33:53 [auto1.de] INFO: Scrape type for BL06566: 2
2026-03-28 05:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6399b34-722a-521e-907e-b5ce4fc30717 with identifier: BL06566
2026-03-28 05:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6399b34-722a-521e-907e-b5ce4fc30717 with scrape type 2
2026-03-28 05:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6399b34-722a-521e-907e-b5ce4fc30717 with scrape type 2
2026-03-28 05:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6399b34-722a-521e-907e-b5ce4fc30717, identifier: BL06566
2026-03-28 05:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6399b34-722a-521e-907e-b5ce4fc30717 with identifier: BL06566
2026-03-28 05:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6399b34-722a-521e-907e-b5ce4fc30717 with identifier: BL06566
2026-03-28 05:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6399b34-722a-521e-907e-b5ce4fc30717 with identifier: BL06566 to the API
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:46:50Z',
 'fuel_type': 'diesel',
 'id': 'f6399b34-722a-521e-907e-b5ce4fc30717',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL06566',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 116158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-03',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Mild-Hybrid Vision",
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2022}
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL06566%27 HTTP/1.1" 200 None
2026-03-28 05:33:53 [auto1.de] INFO: Saving data for BL06566: {'auction_closing_time': 1774716410.0, 'created_time': 1774463631.429456, 'last_price_update_time': 1774676033.712409}
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL06566') HTTP/1.1" 204 0
2026-03-28 05:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:53 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-28 05:33:53 [auto1.de] INFO: Scrape type for UP55946: 2
2026-03-28 05:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946
2026-03-28 05:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de367412-b564-5c37-9ef9-f93836afcfd0 with scrape type 2
2026-03-28 05:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de367412-b564-5c37-9ef9-f93836afcfd0 with scrape type 2
2026-03-28 05:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de367412-b564-5c37-9ef9-f93836afcfd0, identifier: UP55946
2026-03-28 05:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946
2026-03-28 05:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946
2026-03-28 05:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946 to the API
2026-03-28 05:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:52:48Z',
 'fuel_type': 'diesel',
 'id': 'de367412-b564-5c37-9ef9-f93836afcfd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP55946',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 133255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L1H1 Ka 2,8t Ecoline',
 'transmission': 'manual',
 'trim': 'L1H1 Ka 2,8t Ecoline',
 'year': 2015}
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-28 05:33:55 [auto1.de] INFO: Saving data for UP55946: {'auction_closing_time': 1774716768.0, 'created_time': 1773303063.986486, 'last_price_update_time': 1774676035.224675}
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP55946') HTTP/1.1" 204 0
2026-03-28 05:33:55 [auto1.de] INFO: Found listing with ID: KS49041
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS49041%27 HTTP/1.1" 200 None
2026-03-28 05:33:55 [auto1.de] INFO: Scrape type for KS49041: 0
2026-03-28 05:33:55 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-28 05:33:55 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-28 05:33:55 [auto1.de] INFO: Scrape type for AF88464: 2
2026-03-28 05:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464
2026-03-28 05:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with scrape type 2
2026-03-28 05:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with scrape type 2
2026-03-28 05:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbcac482-a0ce-5797-9f0a-655b7f4cbc26, identifier: AF88464
2026-03-28 05:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464
2026-03-28 05:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464
2026-03-28 05:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464 to the API
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:51:10Z',
 'fuel_type': 'petrol',
 'id': 'bbcac482-a0ce-5797-9f0a-655b7f4cbc26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF88464',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 155904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-04',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-28 05:33:55 [auto1.de] INFO: Saving data for AF88464: {'auction_closing_time': 1774716670.0, 'created_time': 1774550647.661147, 'last_price_update_time': 1774676035.677644}
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF88464') HTTP/1.1" 204 0
2026-03-28 05:33:55 [auto1.de] INFO: Found listing with ID: LZ96644
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ96644%27 HTTP/1.1" 200 None
2026-03-28 05:33:55 [auto1.de] INFO: Scrape type for LZ96644: 2
2026-03-28 05:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 284af4cd-f6d8-50b3-b872-0fcea93d970d with identifier: LZ96644
2026-03-28 05:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 284af4cd-f6d8-50b3-b872-0fcea93d970d with scrape type 2
2026-03-28 05:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 284af4cd-f6d8-50b3-b872-0fcea93d970d with scrape type 2
2026-03-28 05:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 284af4cd-f6d8-50b3-b872-0fcea93d970d, identifier: LZ96644
2026-03-28 05:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 284af4cd-f6d8-50b3-b872-0fcea93d970d with identifier: LZ96644
2026-03-28 05:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 284af4cd-f6d8-50b3-b872-0fcea93d970d with identifier: LZ96644
2026-03-28 05:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 284af4cd-f6d8-50b3-b872-0fcea93d970d with identifier: LZ96644 to the API
2026-03-28 05:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:58:16Z',
 'fuel_type': 'diesel',
 'id': '284af4cd-f6d8-50b3-b872-0fcea93d970d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ96644',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 113259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-05',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ96644%27 HTTP/1.1" 200 None
2026-03-28 05:33:56 [auto1.de] INFO: Saving data for LZ96644: {'auction_closing_time': 1774717096.0, 'created_time': 1773136546.928739, 'last_price_update_time': 1774676036.170124}
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ96644') HTTP/1.1" 204 0
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-28 05:33:56 [auto1.de] INFO: Scrape type for TA61960: 0
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: LR83692
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83692%27 HTTP/1.1" 200 None
2026-03-28 05:33:56 [auto1.de] INFO: Scrape type for LR83692: 0
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: KE96769
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: YX71503
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX71503%27 HTTP/1.1" 200 None
2026-03-28 05:33:56 [auto1.de] INFO: Scrape type for YX71503: 0
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: YH65606
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: KL74101
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: PC37120
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC37120%27 HTTP/1.1" 200 None
2026-03-28 05:33:56 [auto1.de] INFO: Scrape type for PC37120: 0
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-28 05:33:56 [auto1.de] INFO: Scrape type for HJ54596: 2
2026-03-28 05:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596
2026-03-28 05:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78dcb082-d16c-5556-aa94-a7fb0d3475ce with scrape type 2
2026-03-28 05:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78dcb082-d16c-5556-aa94-a7fb0d3475ce with scrape type 2
2026-03-28 05:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78dcb082-d16c-5556-aa94-a7fb0d3475ce, identifier: HJ54596
2026-03-28 05:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596
2026-03-28 05:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596
2026-03-28 05:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596 to the API
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:56:26Z',
 'fuel_type': 'gas',
 'id': '78dcb082-d16c-5556-aa94-a7fb0d3475ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ54596',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 69378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2022}
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-28 05:33:56 [auto1.de] INFO: Saving data for HJ54596: {'auction_closing_time': 1774716986.0, 'created_time': 1774552428.278473, 'last_price_update_time': 1774676036.815794}
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ54596') HTTP/1.1" 204 0
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: TJ80177
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: UK07375
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK07375%27 HTTP/1.1" 200 None
2026-03-28 05:33:56 [auto1.de] INFO: Scrape type for UK07375: 0
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: RC17718
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC17718%27 HTTP/1.1" 200 None
2026-03-28 05:33:56 [auto1.de] INFO: Scrape type for RC17718: 0
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: SL45224
2026-03-28 05:33:56 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-28 05:33:56 [auto1.de] INFO: Scrape type for XE57640: 2
2026-03-28 05:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef6949b5-ec31-5639-9cb0-b18f69a3f914 with identifier: XE57640
2026-03-28 05:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef6949b5-ec31-5639-9cb0-b18f69a3f914 with scrape type 2
2026-03-28 05:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef6949b5-ec31-5639-9cb0-b18f69a3f914 with scrape type 2
2026-03-28 05:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef6949b5-ec31-5639-9cb0-b18f69a3f914, identifier: XE57640
2026-03-28 05:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef6949b5-ec31-5639-9cb0-b18f69a3f914 with identifier: XE57640
2026-03-28 05:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef6949b5-ec31-5639-9cb0-b18f69a3f914 with identifier: XE57640
2026-03-28 05:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef6949b5-ec31-5639-9cb0-b18f69a3f914 with identifier: XE57640 to the API
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:59Z',
 'fuel_type': 'diesel',
 'id': 'ef6949b5-ec31-5639-9cb0-b18f69a3f914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE57640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 63635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-28',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2021}
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-28 05:33:57 [auto1.de] INFO: Saving data for XE57640: {'auction_closing_time': 1774714559.0, 'created_time': 1774550621.417665, 'last_price_update_time': 1774676037.387151}
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE57640') HTTP/1.1" 204 0
2026-03-28 05:33:57 [auto1.de] INFO: Found listing with ID: YD41840
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD41840%27 HTTP/1.1" 200 None
2026-03-28 05:33:57 [auto1.de] INFO: Scrape type for YD41840: 0
2026-03-28 05:33:57 [auto1.de] INFO: Found listing with ID: LJ92359
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ92359%27 HTTP/1.1" 200 None
2026-03-28 05:33:57 [auto1.de] INFO: Scrape type for LJ92359: 0
2026-03-28 05:33:57 [auto1.de] INFO: Found listing with ID: AF95896
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF95896%27 HTTP/1.1" 200 None
2026-03-28 05:33:57 [auto1.de] INFO: Scrape type for AF95896: 0
2026-03-28 05:33:57 [auto1.de] INFO: Found listing with ID: DN70998
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN70998%27 HTTP/1.1" 200 None
2026-03-28 05:33:57 [auto1.de] INFO: Scrape type for DN70998: 2
2026-03-28 05:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4216168-c3d7-51c9-9fcc-43e4d6dea1a7 with identifier: DN70998
2026-03-28 05:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4216168-c3d7-51c9-9fcc-43e4d6dea1a7 with scrape type 2
2026-03-28 05:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4216168-c3d7-51c9-9fcc-43e4d6dea1a7 with scrape type 2
2026-03-28 05:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4216168-c3d7-51c9-9fcc-43e4d6dea1a7, identifier: DN70998
2026-03-28 05:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4216168-c3d7-51c9-9fcc-43e4d6dea1a7 with identifier: DN70998
2026-03-28 05:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4216168-c3d7-51c9-9fcc-43e4d6dea1a7 with identifier: DN70998
2026-03-28 05:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4216168-c3d7-51c9-9fcc-43e4d6dea1a7 with identifier: DN70998 to the API
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:23:32Z',
 'fuel_type': 'petrol',
 'id': 'a4216168-c3d7-51c9-9fcc-43e4d6dea1a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN70998',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 40655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2020}
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN70998%27 HTTP/1.1" 200 None
2026-03-28 05:33:57 [auto1.de] INFO: Saving data for DN70998: {'auction_closing_time': 1774715012.0, 'created_time': 1774466767.445094, 'last_price_update_time': 1774676037.900732}
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN70998') HTTP/1.1" 204 0
2026-03-28 05:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:33:58 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 9199 | hits on page: 40
2026-03-28 05:33:58 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-28 05:33:58 [auto1.de] INFO: Scrape type for XB50161: 2
2026-03-28 05:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71ac3805-0b62-5141-8886-cf835a0c86d5 with identifier: XB50161
2026-03-28 05:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ac3805-0b62-5141-8886-cf835a0c86d5 with scrape type 2
2026-03-28 05:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71ac3805-0b62-5141-8886-cf835a0c86d5 with scrape type 2
2026-03-28 05:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71ac3805-0b62-5141-8886-cf835a0c86d5, identifier: XB50161
2026-03-28 05:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71ac3805-0b62-5141-8886-cf835a0c86d5 with identifier: XB50161
2026-03-28 05:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71ac3805-0b62-5141-8886-cf835a0c86d5 with identifier: XB50161
2026-03-28 05:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71ac3805-0b62-5141-8886-cf835a0c86d5 with identifier: XB50161 to the API
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:25:45Z',
 'fuel_type': 'diesel',
 'id': '71ac3805-0b62-5141-8886-cf835a0c86d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB50161',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 96576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 116 CDI lang 4Matic Select',
 'transmission': 'automatic',
 'trim': 'lang 4Matic Select',
 'year': 2017}
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-28 05:33:58 [auto1.de] INFO: Saving data for XB50161: {'auction_closing_time': 1774715145.0, 'created_time': 1774550506.757029, 'last_price_update_time': 1774676038.460986}
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB50161') HTTP/1.1" 204 0
2026-03-28 05:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:33:58 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-28 05:33:58 [auto1.de] INFO: Found listing with ID: DR41029
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR41029%27 HTTP/1.1" 200 None
2026-03-28 05:33:58 [auto1.de] INFO: Scrape type for DR41029: 0
2026-03-28 05:33:58 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-28 05:33:58 [auto1.de] INFO: Scrape type for BL02906: 2
2026-03-28 05:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32f433dc-2ce6-51d2-a2b3-b856df54f75f with identifier: BL02906
2026-03-28 05:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f433dc-2ce6-51d2-a2b3-b856df54f75f with scrape type 2
2026-03-28 05:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32f433dc-2ce6-51d2-a2b3-b856df54f75f with scrape type 2
2026-03-28 05:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32f433dc-2ce6-51d2-a2b3-b856df54f75f, identifier: BL02906
2026-03-28 05:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32f433dc-2ce6-51d2-a2b3-b856df54f75f with identifier: BL02906
2026-03-28 05:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32f433dc-2ce6-51d2-a2b3-b856df54f75f with identifier: BL02906
2026-03-28 05:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32f433dc-2ce6-51d2-a2b3-b856df54f75f with identifier: BL02906 to the API
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-28T16:11:27Z',
 'fuel_type': 'petrol',
 'id': '32f433dc-2ce6-51d2-a2b3-b856df54f75f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL02906',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 81947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Opel Grandland X 1.6 Turbo Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2020}
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-28 05:33:58 [auto1.de] INFO: Saving data for BL02906: {'auction_closing_time': 1774714287.0, 'created_time': 1774552351.930315, 'last_price_update_time': 1774676038.892632}
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL02906') HTTP/1.1" 204 0
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: BF45527
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: CA82513
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Scrape type for TB88794: 2
2026-03-28 05:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794
2026-03-28 05:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44db64be-23d1-518b-b6ae-dfbd5dd836ef with scrape type 2
2026-03-28 05:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44db64be-23d1-518b-b6ae-dfbd5dd836ef with scrape type 2
2026-03-28 05:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44db64be-23d1-518b-b6ae-dfbd5dd836ef, identifier: TB88794
2026-03-28 05:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794
2026-03-28 05:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794
2026-03-28 05:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794 to the API
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:56:46Z',
 'fuel_type': 'petrol',
 'id': '44db64be-23d1-518b-b6ae-dfbd5dd836ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB88794',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 116384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-25',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Saving data for TB88794: {'auction_closing_time': 1774717006.0, 'created_time': 1774552630.815968, 'last_price_update_time': 1774676039.437335}
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB88794') HTTP/1.1" 204 0
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: PY43658
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY43658%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Scrape type for PY43658: 0
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: RY13097
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: HD36742
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD36742%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Scrape type for HD36742: 0
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Scrape type for LB57303: 2
2026-03-28 05:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303
2026-03-28 05:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 946a967a-ea54-56ac-b5ff-18105f40c9e4 with scrape type 2
2026-03-28 05:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 946a967a-ea54-56ac-b5ff-18105f40c9e4 with scrape type 2
2026-03-28 05:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 946a967a-ea54-56ac-b5ff-18105f40c9e4, identifier: LB57303
2026-03-28 05:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303
2026-03-28 05:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303
2026-03-28 05:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303 to the API
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:56:49Z',
 'fuel_type': 'diesel',
 'id': '946a967a-ea54-56ac-b5ff-18105f40c9e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB57303',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 289870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-31',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.9 TDI Trendline 4Motion',
 'transmission': 'manual',
 'trim': 'Trendline 4Motion',
 'year': 2008}
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Saving data for LB57303: {'auction_closing_time': 1774717009.0, 'created_time': 1774552932.056943, 'last_price_update_time': 1774676039.88492}
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB57303') HTTP/1.1" 204 0
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: TP88372
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP88372%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Scrape type for TP88372: 0
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: NN09397
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: ME32399
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Scrape type for GV28684: 0
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: SH94739
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH94739%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Scrape type for SH94739: 0
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: WM81264
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Scrape type for RV27706: 0
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: PZ04284
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ04284%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Scrape type for PZ04284: 0
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: FT79731
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-28 05:33:59 [auto1.de] INFO: Scrape type for HA44433: 0
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-28 05:33:59 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-28 05:34:00 [auto1.de] INFO: Scrape type for VG84958: 2
2026-03-28 05:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958
2026-03-28 05:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64b310b-2d27-529f-bc32-585c17bfedf0 with scrape type 2
2026-03-28 05:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64b310b-2d27-529f-bc32-585c17bfedf0 with scrape type 2
2026-03-28 05:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e64b310b-2d27-529f-bc32-585c17bfedf0, identifier: VG84958
2026-03-28 05:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958
2026-03-28 05:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958
2026-03-28 05:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958 to the API
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-28T16:56:35Z',
 'fuel_type': 'petrol',
 'id': 'e64b310b-2d27-529f-bc32-585c17bfedf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG84958',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Boxster',
 'odometer': 140213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-17',
 'seller_name': None,
 'title': 'Porsche Boxster S',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-28 05:34:00 [auto1.de] INFO: Saving data for VG84958: {'auction_closing_time': 1774716995.0, 'created_time': 1774552137.726342, 'last_price_update_time': 1774676040.479868}
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG84958') HTTP/1.1" 204 0
2026-03-28 05:34:00 [auto1.de] INFO: Found listing with ID: ZS26500
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS26500%27 HTTP/1.1" 200 None
2026-03-28 05:34:00 [auto1.de] INFO: Scrape type for ZS26500: 0
2026-03-28 05:34:00 [auto1.de] INFO: Found listing with ID: LC02400
2026-03-28 05:34:00 [auto1.de] INFO: Found listing with ID: BG27502
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27502%27 HTTP/1.1" 200 None
2026-03-28 05:34:00 [auto1.de] INFO: Scrape type for BG27502: 0
2026-03-28 05:34:00 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-28 05:34:00 [auto1.de] INFO: Found listing with ID: KM40443
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM40443%27 HTTP/1.1" 200 None
2026-03-28 05:34:00 [auto1.de] INFO: Scrape type for KM40443: 0
2026-03-28 05:34:00 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81391%27 HTTP/1.1" 200 None
2026-03-28 05:34:00 [auto1.de] INFO: Scrape type for RB81391: 0
2026-03-28 05:34:00 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-28 05:34:00 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-28 05:34:00 [auto1.de] INFO: Scrape type for YA96721: 0
2026-03-28 05:34:00 [auto1.de] INFO: Found listing with ID: MR13527
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR13527%27 HTTP/1.1" 200 None
2026-03-28 05:34:00 [auto1.de] INFO: Scrape type for MR13527: 0
2026-03-28 05:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:01 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:01 [auto1.de] INFO: Found listing with ID: WU62760
2026-03-28 05:34:01 [auto1.de] INFO: Found listing with ID: DB98628
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB98628%27 HTTP/1.1" 200 None
2026-03-28 05:34:01 [auto1.de] INFO: Scrape type for DB98628: 0
2026-03-28 05:34:01 [auto1.de] INFO: Found listing with ID: TE12513
2026-03-28 05:34:01 [auto1.de] INFO: Found listing with ID: MS10711
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS10711%27 HTTP/1.1" 200 None
2026-03-28 05:34:01 [auto1.de] INFO: Scrape type for MS10711: 0
2026-03-28 05:34:01 [auto1.de] INFO: Found listing with ID: GM94647
2026-03-28 05:34:01 [auto1.de] INFO: Found listing with ID: BS49761
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS49761%27 HTTP/1.1" 200 None
2026-03-28 05:34:01 [auto1.de] INFO: Scrape type for BS49761: 0
2026-03-28 05:34:01 [auto1.de] INFO: Found listing with ID: GK30038
2026-03-28 05:34:01 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89022%27 HTTP/1.1" 200 None
2026-03-28 05:34:01 [auto1.de] INFO: Scrape type for ZT89022: 0
2026-03-28 05:34:01 [auto1.de] INFO: Found listing with ID: MK32086
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32086%27 HTTP/1.1" 200 None
2026-03-28 05:34:01 [auto1.de] INFO: Scrape type for MK32086: 0
2026-03-28 05:34:01 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-28 05:34:01 [auto1.de] INFO: Scrape type for CU27746: 2
2026-03-28 05:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746
2026-03-28 05:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with scrape type 2
2026-03-28 05:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with scrape type 2
2026-03-28 05:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27, identifier: CU27746
2026-03-28 05:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746
2026-03-28 05:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746
2026-03-28 05:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746 to the API
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:33Z',
 'fuel_type': 'petrol',
 'id': '3e3dc7ee-5ff9-58e5-9852-a905648d4a27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU27746',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 50920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-09',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Saving data for CU27746: {'auction_closing_time': 1774716393.0, 'created_time': 1773302561.97334, 'last_price_update_time': 1774676042.098709}
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU27746') HTTP/1.1" 204 0
2026-03-28 05:34:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Scrape type for PR91039: 0
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG07802%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Scrape type for JG07802: 0
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: ZP84126
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Scrape type for AW92068: 0
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: MZ53691
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: EJ11673
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: GP79065
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR07934%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Scrape type for GR07934: 0
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: WV76032
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: KG77617
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: SD72171
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72171%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Scrape type for SD72171: 0
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: ZU63901
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: SU27774
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU27774%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Scrape type for SU27774: 0
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: LX73205
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX73205%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Scrape type for LX73205: 0
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: MV64998
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77842%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Scrape type for LC77842: 0
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: FA77948
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: WK49047
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49047%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Scrape type for WK49047: 0
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: BA71155
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA71155%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Scrape type for BA71155: 0
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: EV18023
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV18023%27 HTTP/1.1" 200 None
2026-03-28 05:34:02 [auto1.de] INFO: Scrape type for EV18023: 0
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-28 05:34:02 [auto1.de] INFO: Found listing with ID: XC96921
2026-03-28 05:34:06 [scrapy.extensions.logstats] INFO: Crawled 85 pages (at 15 pages/min), scraped 268 items (at 67 items/min)
2026-03-28 05:34:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:11 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: GJ82091
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82091%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for GJ82091: 0
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: DZ18684
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ18684%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for DZ18684: 0
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: CS22386
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS22386%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for CS22386: 0
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: MJ41570
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: NZ41454
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ41454%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for NZ41454: 0
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: AT21596
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT21596%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for AT21596: 0
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: ME93940
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME93940%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for ME93940: 0
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: PK76037
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK76037%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for PK76037: 0
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: ZD11825
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD11825%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for ZD11825: 0
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for BD92301: 2
2026-03-28 05:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 653d7bd8-9283-5582-9ee0-ec548f32097e with identifier: BD92301
2026-03-28 05:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 653d7bd8-9283-5582-9ee0-ec548f32097e with scrape type 2
2026-03-28 05:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 653d7bd8-9283-5582-9ee0-ec548f32097e with scrape type 2
2026-03-28 05:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 653d7bd8-9283-5582-9ee0-ec548f32097e, identifier: BD92301
2026-03-28 05:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 653d7bd8-9283-5582-9ee0-ec548f32097e with identifier: BD92301
2026-03-28 05:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 653d7bd8-9283-5582-9ee0-ec548f32097e with identifier: BD92301
2026-03-28 05:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 653d7bd8-9283-5582-9ee0-ec548f32097e with identifier: BD92301 to the API
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:26:36Z',
 'fuel_type': 'petrol',
 'id': '653d7bd8-9283-5582-9ee0-ec548f32097e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD92301',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 160298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-11-15',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2000}
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Saving data for BD92301: {'auction_closing_time': 1774715196.0, 'created_time': 1774551445.545583, 'last_price_update_time': 1774676051.765401}
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD92301') HTTP/1.1" 204 0
2026-03-28 05:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: CK82561
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: MJ46117
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ46117%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for MJ46117: 0
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: HH84290
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: RP33469
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: VT95404
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT95404%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for VT95404: 0
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-28 05:34:11 [auto1.de] INFO: Found listing with ID: CN84106
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN84106%27 HTTP/1.1" 200 None
2026-03-28 05:34:11 [auto1.de] INFO: Scrape type for CN84106: 2
2026-03-28 05:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e2945ef-9164-5b53-88b5-27a9c1a6b8cc with identifier: CN84106
2026-03-28 05:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e2945ef-9164-5b53-88b5-27a9c1a6b8cc with scrape type 2
2026-03-28 05:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e2945ef-9164-5b53-88b5-27a9c1a6b8cc with scrape type 2
2026-03-28 05:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e2945ef-9164-5b53-88b5-27a9c1a6b8cc, identifier: CN84106
2026-03-28 05:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e2945ef-9164-5b53-88b5-27a9c1a6b8cc with identifier: CN84106
2026-03-28 05:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e2945ef-9164-5b53-88b5-27a9c1a6b8cc with identifier: CN84106
2026-03-28 05:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e2945ef-9164-5b53-88b5-27a9c1a6b8cc with identifier: CN84106 to the API
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:11:35Z',
 'fuel_type': 'petrol',
 'id': '3e2945ef-9164-5b53-88b5-27a9c1a6b8cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN84106',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 244540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-01',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2013}
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN84106%27 HTTP/1.1" 200 None
2026-03-28 05:34:12 [auto1.de] INFO: Saving data for CN84106: {'auction_closing_time': 1774714295.0, 'created_time': 1774550654.91312, 'last_price_update_time': 1774676052.341253}
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN84106') HTTP/1.1" 204 0
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: XV81276
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: AB82349
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: XR02791
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR02791%27 HTTP/1.1" 200 None
2026-03-28 05:34:12 [auto1.de] INFO: Scrape type for XR02791: 0
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: FK98396
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: GW25301
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: DS74430
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: XE55302
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE55302%27 HTTP/1.1" 200 None
2026-03-28 05:34:12 [auto1.de] INFO: Scrape type for XE55302: 2
2026-03-28 05:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c9b9733-dc8f-5ec7-adc9-dfed62fabfda with identifier: XE55302
2026-03-28 05:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c9b9733-dc8f-5ec7-adc9-dfed62fabfda with scrape type 2
2026-03-28 05:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c9b9733-dc8f-5ec7-adc9-dfed62fabfda with scrape type 2
2026-03-28 05:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c9b9733-dc8f-5ec7-adc9-dfed62fabfda, identifier: XE55302
2026-03-28 05:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c9b9733-dc8f-5ec7-adc9-dfed62fabfda with identifier: XE55302
2026-03-28 05:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c9b9733-dc8f-5ec7-adc9-dfed62fabfda with identifier: XE55302
2026-03-28 05:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c9b9733-dc8f-5ec7-adc9-dfed62fabfda with identifier: XE55302 to the API
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:13:48Z',
 'fuel_type': 'petrol',
 'id': '0c9b9733-dc8f-5ec7-adc9-dfed62fabfda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE55302',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 129857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-01',
 'seller_name': None,
 'title': 'Kia Soul 1.6 GDI Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2018}
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE55302%27 HTTP/1.1" 200 None
2026-03-28 05:34:12 [auto1.de] INFO: Saving data for XE55302: {'auction_closing_time': 1774714428.0, 'created_time': 1774552471.991472, 'last_price_update_time': 1774676052.791119}
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE55302') HTTP/1.1" 204 0
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: GE49775
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: KN20653
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: ZZ49819
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49819%27 HTTP/1.1" 200 None
2026-03-28 05:34:12 [auto1.de] INFO: Scrape type for ZZ49819: 0
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: JF61688
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF61688%27 HTTP/1.1" 200 None
2026-03-28 05:34:12 [auto1.de] INFO: Scrape type for JF61688: 0
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: ZM65799
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: LN55732
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN55732%27 HTTP/1.1" 200 None
2026-03-28 05:34:12 [auto1.de] INFO: Scrape type for LN55732: 0
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: MM30364
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM30364%27 HTTP/1.1" 200 None
2026-03-28 05:34:12 [auto1.de] INFO: Scrape type for MM30364: 0
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: SX57791
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: NM13557
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM13557%27 HTTP/1.1" 200 None
2026-03-28 05:34:12 [auto1.de] INFO: Scrape type for NM13557: 0
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: LD46189
2026-03-28 05:34:12 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET29931%27 HTTP/1.1" 200 None
2026-03-28 05:34:12 [auto1.de] INFO: Scrape type for ET29931: 0
2026-03-28 05:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:14 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: GU26871
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU26871%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for GU26871: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: XE39544
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: UE09477
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for LH30739: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: CC98432
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98432%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for CC98432: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for PS42902: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: PH91659
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: AR52184
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: JK90168
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for JH22526: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: RK01073
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK01073%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for RK01073: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37752%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for MX37752: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: YM52195
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM52195%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for YM52195: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: VJ16820
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ16820%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for VJ16820: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: VV84209
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for KN80130: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: EW23969
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: FT93387
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT93387%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for FT93387: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for CH69099: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: FH56090
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH56090%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for FH56090: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: PS41324
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: JB65350
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB65350%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for JB65350: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: MJ38460
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: JC93229
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for TP70009: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for BY42207: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for AP34925: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: LU46905
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: RL83266
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for AA51921: 2
2026-03-28 05:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921
2026-03-28 05:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32cf3593-42a2-54cf-aeee-6e07c47047ac with scrape type 2
2026-03-28 05:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32cf3593-42a2-54cf-aeee-6e07c47047ac with scrape type 2
2026-03-28 05:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32cf3593-42a2-54cf-aeee-6e07c47047ac, identifier: AA51921
2026-03-28 05:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921
2026-03-28 05:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921
2026-03-28 05:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921 to the API
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:53:01Z',
 'fuel_type': 'diesel',
 'id': '32cf3593-42a2-54cf-aeee-6e07c47047ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA51921',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 48182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-15',
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Kasten Sport Lang',
 'transmission': 'manual',
 'trim': 'Kasten Sport Lang',
 'year': 2017}
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Saving data for AA51921: {'auction_closing_time': 1774716781.0, 'created_time': 1774552732.297613, 'last_price_update_time': 1774676054.796891}
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA51921') HTTP/1.1" 204 0
2026-03-28 05:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: TR42945
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: UN09274
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: KH43150
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: YU64534
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU64534%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for YU64534: 0
2026-03-28 05:34:14 [auto1.de] INFO: Found listing with ID: PY53054
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY53054%27 HTTP/1.1" 200 None
2026-03-28 05:34:14 [auto1.de] INFO: Scrape type for PY53054: 0
2026-03-28 05:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:18 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:18 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ83553%27 HTTP/1.1" 200 None
2026-03-28 05:34:18 [auto1.de] INFO: Scrape type for SJ83553: 0
2026-03-28 05:34:18 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-28 05:34:18 [auto1.de] INFO: Scrape type for FM49388: 2
2026-03-28 05:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09264a1a-33a6-5933-b4e7-2a60cdca7418 with identifier: FM49388
2026-03-28 05:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09264a1a-33a6-5933-b4e7-2a60cdca7418 with scrape type 2
2026-03-28 05:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09264a1a-33a6-5933-b4e7-2a60cdca7418 with scrape type 2
2026-03-28 05:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09264a1a-33a6-5933-b4e7-2a60cdca7418, identifier: FM49388
2026-03-28 05:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09264a1a-33a6-5933-b4e7-2a60cdca7418 with identifier: FM49388
2026-03-28 05:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09264a1a-33a6-5933-b4e7-2a60cdca7418 with identifier: FM49388
2026-03-28 05:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09264a1a-33a6-5933-b4e7-2a60cdca7418 with identifier: FM49388 to the API
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:13:07Z',
 'fuel_type': 'diesel',
 'id': '09264a1a-33a6-5933-b4e7-2a60cdca7418',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM49388',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 232922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-28 05:34:18 [auto1.de] INFO: Saving data for FM49388: {'auction_closing_time': 1774714387.0, 'created_time': 1774550496.424591, 'last_price_update_time': 1774676058.610842}
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM49388') HTTP/1.1" 204 0
2026-03-28 05:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:18 [auto1.de] INFO: Found listing with ID: BZ51273
2026-03-28 05:34:18 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-28 05:34:18 [auto1.de] INFO: Scrape type for EE74949: 2
2026-03-28 05:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with identifier: EE74949
2026-03-28 05:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with scrape type 2
2026-03-28 05:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with scrape type 2
2026-03-28 05:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf16192a-aca0-53cc-bbf1-9e9aa93aa224, identifier: EE74949
2026-03-28 05:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with identifier: EE74949
2026-03-28 05:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with identifier: EE74949
2026-03-28 05:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with identifier: EE74949 to the API
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:13:34Z',
 'fuel_type': 'diesel',
 'id': 'cf16192a-aca0-53cc-bbf1-9e9aa93aa224',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE74949',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 121036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-18',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2018}
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Saving data for EE74949: {'auction_closing_time': 1774714414.0, 'created_time': 1774552553.055673, 'last_price_update_time': 1774676059.049617}
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE74949') HTTP/1.1" 204 0
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: MV36698
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: GR83523
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: BE42770
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE42770%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Scrape type for BE42770: 0
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: KJ27126
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ27126%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Scrape type for KJ27126: 0
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: XA01561
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA01561%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Scrape type for XA01561: 0
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: JD86845
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: FX79800
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Scrape type for YM11561: 2
2026-03-28 05:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561
2026-03-28 05:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38dc16c-f002-590a-9f8a-847082f8cc7a with scrape type 2
2026-03-28 05:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f38dc16c-f002-590a-9f8a-847082f8cc7a with scrape type 2
2026-03-28 05:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f38dc16c-f002-590a-9f8a-847082f8cc7a, identifier: YM11561
2026-03-28 05:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561
2026-03-28 05:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561
2026-03-28 05:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561 to the API
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:04:14Z',
 'fuel_type': 'diesel',
 'id': 'f38dc16c-f002-590a-9f8a-847082f8cc7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM11561',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 97688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-19',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2019}
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Saving data for YM11561: {'auction_closing_time': 1774713854.0, 'created_time': 1774553011.95982, 'last_price_update_time': 1774676059.55165}
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM11561') HTTP/1.1" 204 0
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: AG57248
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: RM09243
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: NX12512
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX12512%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Scrape type for NX12512: 0
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: WD01270
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Scrape type for GB76211: 0
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: XZ96479
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: YY13791
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13791%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Scrape type for YY13791: 0
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Scrape type for MM04684: 0
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Scrape type for MP44977: 0
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-28 05:34:19 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-28 05:34:19 [auto1.de] INFO: Scrape type for ES44709: 2
2026-03-28 05:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf1284d-20cc-595c-9384-9b4d4d4d30a5 with identifier: ES44709
2026-03-28 05:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf1284d-20cc-595c-9384-9b4d4d4d30a5 with scrape type 2
2026-03-28 05:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acf1284d-20cc-595c-9384-9b4d4d4d30a5 with scrape type 2
2026-03-28 05:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acf1284d-20cc-595c-9384-9b4d4d4d30a5, identifier: ES44709
2026-03-28 05:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acf1284d-20cc-595c-9384-9b4d4d4d30a5 with identifier: ES44709
2026-03-28 05:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acf1284d-20cc-595c-9384-9b4d4d4d30a5 with identifier: ES44709
2026-03-28 05:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acf1284d-20cc-595c-9384-9b4d4d4d30a5 with identifier: ES44709 to the API
2026-03-28 05:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:25:09Z',
 'fuel_type': 'petrol',
 'id': 'acf1284d-20cc-595c-9384-9b4d4d4d30a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES44709',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 19149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-07',
 'seller_name': None,
 'title': "Kia cee'd 1.5 TGDI Nightline Edition",
 'transmission': 'manual',
 'trim': 'Nightline Edition',
 'year': 2024}
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-28 05:34:20 [auto1.de] INFO: Saving data for ES44709: {'auction_closing_time': 1774715109.0, 'created_time': 1774551494.759644, 'last_price_update_time': 1774676060.173587}
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES44709') HTTP/1.1" 204 0
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: XS81054
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS81054%27 HTTP/1.1" 200 None
2026-03-28 05:34:20 [auto1.de] INFO: Scrape type for XS81054: 0
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: RV98185
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV98185%27 HTTP/1.1" 200 None
2026-03-28 05:34:20 [auto1.de] INFO: Scrape type for RV98185: 0
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: XS50208
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: RZ65813
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: BZ50840
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: TC55492
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC55492%27 HTTP/1.1" 200 None
2026-03-28 05:34:20 [auto1.de] INFO: Scrape type for TC55492: 0
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: AR80743
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: LZ29816
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ29816%27 HTTP/1.1" 200 None
2026-03-28 05:34:20 [auto1.de] INFO: Scrape type for LZ29816: 2
2026-03-28 05:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with identifier: LZ29816
2026-03-28 05:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with scrape type 2
2026-03-28 05:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with scrape type 2
2026-03-28 05:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b094d01-b9f0-5e55-87dc-35e30dd8efa8, identifier: LZ29816
2026-03-28 05:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with identifier: LZ29816
2026-03-28 05:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with identifier: LZ29816
2026-03-28 05:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b094d01-b9f0-5e55-87dc-35e30dd8efa8 with identifier: LZ29816 to the API
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:44:28Z',
 'fuel_type': 'diesel',
 'id': '3b094d01-b9f0-5e55-87dc-35e30dd8efa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ29816',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 79388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-21',
 'seller_name': None,
 'title': 'Audi A6 Allroad 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ29816%27 HTTP/1.1" 200 None
2026-03-28 05:34:20 [auto1.de] INFO: Saving data for LZ29816: {'auction_closing_time': 1774716268.0, 'created_time': 1774464486.235881, 'last_price_update_time': 1774676060.760485}
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ29816') HTTP/1.1" 204 0
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: JW22409
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW22409%27 HTTP/1.1" 200 None
2026-03-28 05:34:20 [auto1.de] INFO: Scrape type for JW22409: 0
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: FE77986
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE77986%27 HTTP/1.1" 200 None
2026-03-28 05:34:20 [auto1.de] INFO: Scrape type for FE77986: 0
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: GB55517
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB55517%27 HTTP/1.1" 200 None
2026-03-28 05:34:20 [auto1.de] INFO: Scrape type for GB55517: 0
2026-03-28 05:34:20 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-28 05:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:21 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:21 [auto1.de] INFO: Found listing with ID: UD97315
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD97315%27 HTTP/1.1" 200 None
2026-03-28 05:34:22 [auto1.de] INFO: Scrape type for UD97315: 0
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: EW93148
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: ZN11233
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: ME08351
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: DK08351
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: YG22612
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: UZ22488
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-28 05:34:22 [auto1.de] INFO: Scrape type for EN23227: 0
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: CT54176
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: RM92330
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM92330%27 HTTP/1.1" 200 None
2026-03-28 05:34:22 [auto1.de] INFO: Scrape type for RM92330: 2
2026-03-28 05:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 977589e4-083d-5996-941d-cb095a62037f with identifier: RM92330
2026-03-28 05:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977589e4-083d-5996-941d-cb095a62037f with scrape type 2
2026-03-28 05:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 977589e4-083d-5996-941d-cb095a62037f with scrape type 2
2026-03-28 05:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 977589e4-083d-5996-941d-cb095a62037f, identifier: RM92330
2026-03-28 05:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 977589e4-083d-5996-941d-cb095a62037f with identifier: RM92330
2026-03-28 05:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 977589e4-083d-5996-941d-cb095a62037f with identifier: RM92330
2026-03-28 05:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 977589e4-083d-5996-941d-cb095a62037f with identifier: RM92330 to the API
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:31:07Z',
 'fuel_type': 'diesel',
 'id': '977589e4-083d-5996-941d-cb095a62037f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM92330',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 198813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-27',
 'seller_name': None,
 'title': 'BMW 5er 530d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM92330%27 HTTP/1.1" 200 None
2026-03-28 05:34:22 [auto1.de] INFO: Saving data for RM92330: {'auction_closing_time': 1774715467.0, 'created_time': 1773305970.064733, 'last_price_update_time': 1774676062.500675}
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM92330') HTTP/1.1" 204 0
2026-03-28 05:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK43665%27 HTTP/1.1" 200 None
2026-03-28 05:34:22 [auto1.de] INFO: Scrape type for DK43665: 0
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: YZ92306
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: NA68427
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: YB09580
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB09580%27 HTTP/1.1" 200 None
2026-03-28 05:34:22 [auto1.de] INFO: Scrape type for YB09580: 0
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: GZ67786
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: UN40728
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN40728%27 HTTP/1.1" 200 None
2026-03-28 05:34:22 [auto1.de] INFO: Scrape type for UN40728: 0
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: KU77644
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU77644%27 HTTP/1.1" 200 None
2026-03-28 05:34:22 [auto1.de] INFO: Scrape type for KU77644: 0
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: RK25728
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: GE71174
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: WL63965
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL63965%27 HTTP/1.1" 200 None
2026-03-28 05:34:22 [auto1.de] INFO: Scrape type for WL63965: 0
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: YR16927
2026-03-28 05:34:22 [auto1.de] INFO: Found listing with ID: PD02193
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD02193%27 HTTP/1.1" 200 None
2026-03-28 05:34:22 [auto1.de] INFO: Scrape type for PD02193: 2
2026-03-28 05:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfa6adf0-cf08-5d5a-87e6-ce1fff8c7b08 with identifier: PD02193
2026-03-28 05:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfa6adf0-cf08-5d5a-87e6-ce1fff8c7b08 with scrape type 2
2026-03-28 05:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfa6adf0-cf08-5d5a-87e6-ce1fff8c7b08 with scrape type 2
2026-03-28 05:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bfa6adf0-cf08-5d5a-87e6-ce1fff8c7b08, identifier: PD02193
2026-03-28 05:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bfa6adf0-cf08-5d5a-87e6-ce1fff8c7b08 with identifier: PD02193
2026-03-28 05:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bfa6adf0-cf08-5d5a-87e6-ce1fff8c7b08 with identifier: PD02193
2026-03-28 05:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bfa6adf0-cf08-5d5a-87e6-ce1fff8c7b08 with identifier: PD02193 to the API
2026-03-28 05:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:06:06Z',
 'fuel_type': 'petrol',
 'id': 'bfa6adf0-cf08-5d5a-87e6-ce1fff8c7b08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD02193',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 195065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-05-27',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2002}
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD02193%27 HTTP/1.1" 200 None
2026-03-28 05:34:23 [auto1.de] INFO: Saving data for PD02193: {'auction_closing_time': 1774713966.0, 'created_time': 1774465419.293515, 'last_price_update_time': 1774676063.131648}
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD02193') HTTP/1.1" 204 0
2026-03-28 05:34:23 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-28 05:34:23 [auto1.de] INFO: Scrape type for LM46602: 2
2026-03-28 05:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ebf77e-8661-5c8c-9380-a600fe4ba38a with identifier: LM46602
2026-03-28 05:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ebf77e-8661-5c8c-9380-a600fe4ba38a with scrape type 2
2026-03-28 05:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60ebf77e-8661-5c8c-9380-a600fe4ba38a with scrape type 2
2026-03-28 05:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60ebf77e-8661-5c8c-9380-a600fe4ba38a, identifier: LM46602
2026-03-28 05:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60ebf77e-8661-5c8c-9380-a600fe4ba38a with identifier: LM46602
2026-03-28 05:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60ebf77e-8661-5c8c-9380-a600fe4ba38a with identifier: LM46602
2026-03-28 05:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60ebf77e-8661-5c8c-9380-a600fe4ba38a with identifier: LM46602 to the API
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:54Z',
 'fuel_type': 'petrol',
 'id': '60ebf77e-8661-5c8c-9380-a600fe4ba38a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM46602',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 106381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-21',
 'seller_name': None,
 'title': 'Mazda 5 2.0 Sendo',
 'transmission': 'manual',
 'trim': 'Sendo',
 'year': 2015}
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-28 05:34:23 [auto1.de] INFO: Saving data for LM46602: {'auction_closing_time': 1774714974.0, 'created_time': 1774550642.446887, 'last_price_update_time': 1774676063.651451}
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM46602') HTTP/1.1" 204 0
2026-03-28 05:34:23 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-28 05:34:23 [auto1.de] INFO: Scrape type for HL50945: 0
2026-03-28 05:34:23 [auto1.de] INFO: Found listing with ID: TY96424
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY96424%27 HTTP/1.1" 200 None
2026-03-28 05:34:23 [auto1.de] INFO: Scrape type for TY96424: 0
2026-03-28 05:34:23 [auto1.de] INFO: Found listing with ID: ES32816
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES32816%27 HTTP/1.1" 200 None
2026-03-28 05:34:23 [auto1.de] INFO: Scrape type for ES32816: 0
2026-03-28 05:34:23 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-28 05:34:23 [auto1.de] INFO: Scrape type for BR02307: 2
2026-03-28 05:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307
2026-03-28 05:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9fc1597-97d9-5093-981f-75f1459966f8 with scrape type 2
2026-03-28 05:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9fc1597-97d9-5093-981f-75f1459966f8 with scrape type 2
2026-03-28 05:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9fc1597-97d9-5093-981f-75f1459966f8, identifier: BR02307
2026-03-28 05:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307
2026-03-28 05:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307
2026-03-28 05:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307 to the API
2026-03-28 05:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:48:03Z',
 'fuel_type': 'petrol',
 'id': 'c9fc1597-97d9-5093-981f-75f1459966f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR02307',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 168486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-21',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-28 05:34:24 [auto1.de] INFO: Saving data for BR02307: {'auction_closing_time': 1774716483.0, 'created_time': 1774551478.276678, 'last_price_update_time': 1774676064.132763}
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR02307') HTTP/1.1" 204 0
2026-03-28 05:34:24 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-28 05:34:24 [auto1.de] INFO: Scrape type for NH81971: 2
2026-03-28 05:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971
2026-03-28 05:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d500038-8bc4-5523-abeb-64df60507f7f with scrape type 2
2026-03-28 05:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d500038-8bc4-5523-abeb-64df60507f7f with scrape type 2
2026-03-28 05:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d500038-8bc4-5523-abeb-64df60507f7f, identifier: NH81971
2026-03-28 05:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971
2026-03-28 05:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971
2026-03-28 05:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971 to the API
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:23Z',
 'fuel_type': 'petrol',
 'id': '8d500038-8bc4-5523-abeb-64df60507f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH81971',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 127680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-17',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-28 05:34:24 [auto1.de] INFO: Saving data for NH81971: {'auction_closing_time': 1774716143.0, 'created_time': 1773341410.983319, 'last_price_update_time': 1774676064.61856}
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH81971') HTTP/1.1" 204 0
2026-03-28 05:34:24 [auto1.de] INFO: Found listing with ID: GE82925
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE82925%27 HTTP/1.1" 200 None
2026-03-28 05:34:24 [auto1.de] INFO: Scrape type for GE82925: 0
2026-03-28 05:34:24 [auto1.de] INFO: Found listing with ID: BK55447
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK55447%27 HTTP/1.1" 200 None
2026-03-28 05:34:24 [auto1.de] INFO: Scrape type for BK55447: 0
2026-03-28 05:34:24 [auto1.de] INFO: Found listing with ID: TD64872
2026-03-28 05:34:24 [auto1.de] INFO: Found listing with ID: VH83950
2026-03-28 05:34:24 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-28 05:34:24 [auto1.de] INFO: Scrape type for EH25554: 2
2026-03-28 05:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554
2026-03-28 05:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with scrape type 2
2026-03-28 05:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with scrape type 2
2026-03-28 05:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a, identifier: EH25554
2026-03-28 05:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=purple HTTP/1.1" 200 None
2026-03-28 05:34:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554
2026-03-28 05:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554 to the API
2026-03-28 05:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'purple',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:56:31Z',
 'fuel_type': 'diesel',
 'id': '1e2eed26-73a1-5058-8d45-a0b4e6f62e2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH25554',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 295931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-30',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 1.5 Turbodiesel I-Way',
 'transmission': 'manual',
 'trim': 'I-Way',
 'year': 2011}
2026-03-28 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-28 05:34:25 [auto1.de] INFO: Saving data for EH25554: {'auction_closing_time': 1774716991.0, 'created_time': 1774550524.354712, 'last_price_update_time': 1774676065.233627}
2026-03-28 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH25554') HTTP/1.1" 204 0
2026-03-28 05:34:25 [auto1.de] INFO: Found listing with ID: CS89362
2026-03-28 05:34:25 [auto1.de] INFO: Found listing with ID: BK72669
2026-03-28 05:34:25 [auto1.de] INFO: Found listing with ID: RL57383
2026-03-28 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL57383%27 HTTP/1.1" 200 None
2026-03-28 05:34:25 [auto1.de] INFO: Scrape type for RL57383: 0
2026-03-28 05:34:25 [auto1.de] INFO: Found listing with ID: SN89547
2026-03-28 05:34:25 [auto1.de] INFO: Found listing with ID: JX39487
2026-03-28 05:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:26 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC27418%27 HTTP/1.1" 200 None
2026-03-28 05:34:26 [auto1.de] INFO: Scrape type for CC27418: 0
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60599%27 HTTP/1.1" 200 None
2026-03-28 05:34:26 [auto1.de] INFO: Scrape type for BF60599: 0
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: NC93129
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC93129%27 HTTP/1.1" 200 None
2026-03-28 05:34:26 [auto1.de] INFO: Scrape type for NC93129: 0
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: JC97573
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-28 05:34:26 [auto1.de] INFO: Scrape type for VC98877: 0
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: KK41609
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK41609%27 HTTP/1.1" 200 None
2026-03-28 05:34:26 [auto1.de] INFO: Scrape type for KK41609: 0
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: UV13467
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: RX19676
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: HM31508
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM31508%27 HTTP/1.1" 200 None
2026-03-28 05:34:26 [auto1.de] INFO: Scrape type for HM31508: 0
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: LE88532
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: CN59781
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN59781%27 HTTP/1.1" 200 None
2026-03-28 05:34:26 [auto1.de] INFO: Scrape type for CN59781: 0
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: ZG99162
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: YT47833
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-28 05:34:26 [auto1.de] INFO: Scrape type for WJ94391: 2
2026-03-28 05:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with identifier: WJ94391
2026-03-28 05:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with scrape type 2
2026-03-28 05:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with scrape type 2
2026-03-28 05:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25fc022a-5ae3-5f71-8b08-2bc5423e4d77, identifier: WJ94391
2026-03-28 05:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with identifier: WJ94391
2026-03-28 05:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with identifier: WJ94391
2026-03-28 05:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with identifier: WJ94391 to the API
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:22:40Z',
 'fuel_type': 'petrol',
 'id': '25fc022a-5ae3-5f71-8b08-2bc5423e4d77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ94391',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 46789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-14',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2020}
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-28 05:34:26 [auto1.de] INFO: Saving data for WJ94391: {'auction_closing_time': 1774714960.0, 'created_time': 1774552200.173243, 'last_price_update_time': 1774676066.752741}
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ94391') HTTP/1.1" 204 0
2026-03-28 05:34:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: VV51818
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: CT61733
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT61733%27 HTTP/1.1" 200 None
2026-03-28 05:34:26 [auto1.de] INFO: Scrape type for CT61733: 0
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: WW54945
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: NC87687
2026-03-28 05:34:26 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-28 05:34:26 [auto1.de] INFO: Scrape type for VH61709: 2
2026-03-28 05:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709
2026-03-28 05:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e457e378-4d4d-59aa-8764-8a46dffa1adf with scrape type 2
2026-03-28 05:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e457e378-4d4d-59aa-8764-8a46dffa1adf with scrape type 2
2026-03-28 05:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e457e378-4d4d-59aa-8764-8a46dffa1adf, identifier: VH61709
2026-03-28 05:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709
2026-03-28 05:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709
2026-03-28 05:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709 to the API
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:53:27Z',
 'fuel_type': 'petrol',
 'id': 'e457e378-4d4d-59aa-8764-8a46dffa1adf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH61709',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 242960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-27',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Viva',
 'transmission': 'manual',
 'trim': 'Viva',
 'year': 2010}
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-28 05:34:27 [auto1.de] INFO: Saving data for VH61709: {'auction_closing_time': 1774716807.0, 'created_time': 1773917096.745121, 'last_price_update_time': 1774676067.320693}
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH61709') HTTP/1.1" 204 0
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: PC62388
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62388%27 HTTP/1.1" 200 None
2026-03-28 05:34:27 [auto1.de] INFO: Scrape type for PC62388: 0
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: EL27695
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: ND00067
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: ZF09358
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: AE37337
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE37337%27 HTTP/1.1" 200 None
2026-03-28 05:34:27 [auto1.de] INFO: Scrape type for AE37337: 0
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: AL53534
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: MK52280
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: TH96479
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: TD39885
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD39885%27 HTTP/1.1" 200 None
2026-03-28 05:34:27 [auto1.de] INFO: Scrape type for TD39885: 0
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: KT42918
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT42918%27 HTTP/1.1" 200 None
2026-03-28 05:34:27 [auto1.de] INFO: Scrape type for KT42918: 0
2026-03-28 05:34:27 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-28 05:34:27 [auto1.de] INFO: Scrape type for GM15631: 2
2026-03-28 05:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e02bbc5a-9714-5f51-996c-d2dd70322067 with identifier: GM15631
2026-03-28 05:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e02bbc5a-9714-5f51-996c-d2dd70322067 with scrape type 2
2026-03-28 05:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e02bbc5a-9714-5f51-996c-d2dd70322067 with scrape type 2
2026-03-28 05:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e02bbc5a-9714-5f51-996c-d2dd70322067, identifier: GM15631
2026-03-28 05:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e02bbc5a-9714-5f51-996c-d2dd70322067 with identifier: GM15631
2026-03-28 05:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e02bbc5a-9714-5f51-996c-d2dd70322067 with identifier: GM15631
2026-03-28 05:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e02bbc5a-9714-5f51-996c-d2dd70322067 with identifier: GM15631 to the API
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:40Z',
 'fuel_type': 'petrol',
 'id': 'e02bbc5a-9714-5f51-996c-d2dd70322067',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM15631',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 92076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seller_name': None,
 'title': 'Audi A3 Limousine 35 TFSI Mild-Hybrid edition one',
 'transmission': 'automatic',
 'trim': 'edition one',
 'year': 2020}
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-28 05:34:27 [auto1.de] INFO: Saving data for GM15631: {'auction_closing_time': 1774715500.0, 'created_time': 1774550469.559753, 'last_price_update_time': 1774676067.920836}
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM15631') HTTP/1.1" 204 0
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: HY87386
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: AF90097
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: HZ17968
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: AN69467
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: VX66277
2026-03-28 05:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:28 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: BB75752
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: RB10929
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-28 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-28 05:34:28 [auto1.de] INFO: Scrape type for GV24790: 0
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-28 05:34:28 [auto1.de] INFO: Found listing with ID: SU97431
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU97431%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for SU97431: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: XZ80184
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: NS70849
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS70849%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for NS70849: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: ZF90785
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF90785%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for ZF90785: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for VX15000: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: GP51980
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP51980%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for GP51980: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: XA96250
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: AP31336
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: DV16479
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV16479%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for DV16479: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for BB98458: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: JH14314
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for KE01468: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: VV42849
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV42849%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for VV42849: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: KD57874
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD57874%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for KD57874: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: PB20656
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB20656%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for PB20656: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for VH78915: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for CM15300: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for DJ81890: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD77753%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for TD77753: 2
2026-03-28 05:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e940e327-0927-5940-aa1d-61887c2dbaea with identifier: TD77753
2026-03-28 05:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e940e327-0927-5940-aa1d-61887c2dbaea with scrape type 2
2026-03-28 05:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e940e327-0927-5940-aa1d-61887c2dbaea with scrape type 2
2026-03-28 05:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e940e327-0927-5940-aa1d-61887c2dbaea, identifier: TD77753
2026-03-28 05:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e940e327-0927-5940-aa1d-61887c2dbaea with identifier: TD77753
2026-03-28 05:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e940e327-0927-5940-aa1d-61887c2dbaea with identifier: TD77753
2026-03-28 05:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e940e327-0927-5940-aa1d-61887c2dbaea with identifier: TD77753 to the API
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:51:54Z',
 'fuel_type': 'diesel',
 'id': 'e940e327-0927-5940-aa1d-61887c2dbaea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD77753',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 295390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-03',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement 4x4',
 'year': 2019}
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD77753%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Saving data for TD77753: {'auction_closing_time': 1774716714.0, 'created_time': 1772546704.381304, 'last_price_update_time': 1774676069.716179}
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD77753') HTTP/1.1" 204 0
2026-03-28 05:34:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: WD61316
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: NK36025
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK36025%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for NK36025: 0
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-28 05:34:29 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-28 05:34:29 [auto1.de] INFO: Scrape type for SX52884: 2
2026-03-28 05:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9293a7fc-975c-5476-8095-8bbef582dac7 with identifier: SX52884
2026-03-28 05:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9293a7fc-975c-5476-8095-8bbef582dac7 with scrape type 2
2026-03-28 05:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9293a7fc-975c-5476-8095-8bbef582dac7 with scrape type 2
2026-03-28 05:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9293a7fc-975c-5476-8095-8bbef582dac7, identifier: SX52884
2026-03-28 05:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9293a7fc-975c-5476-8095-8bbef582dac7 with identifier: SX52884
2026-03-28 05:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9293a7fc-975c-5476-8095-8bbef582dac7 with identifier: SX52884
2026-03-28 05:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9293a7fc-975c-5476-8095-8bbef582dac7 with identifier: SX52884 to the API
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:11:33Z',
 'fuel_type': 'petrol',
 'id': '9293a7fc-975c-5476-8095-8bbef582dac7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX52884',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 38484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2020}
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-28 05:34:30 [auto1.de] INFO: Saving data for SX52884: {'auction_closing_time': 1774714293.0, 'created_time': 1773916961.561876, 'last_price_update_time': 1774676070.288046}
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX52884') HTTP/1.1" 204 0
2026-03-28 05:34:30 [auto1.de] INFO: Found listing with ID: XK74156
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK74156%27 HTTP/1.1" 200 None
2026-03-28 05:34:30 [auto1.de] INFO: Scrape type for XK74156: 0
2026-03-28 05:34:30 [auto1.de] INFO: Found listing with ID: VG76144
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG76144%27 HTTP/1.1" 200 None
2026-03-28 05:34:30 [auto1.de] INFO: Scrape type for VG76144: 0
2026-03-28 05:34:30 [auto1.de] INFO: Found listing with ID: HW97387
2026-03-28 05:34:30 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-28 05:34:30 [auto1.de] INFO: Scrape type for ZJ78917: 2
2026-03-28 05:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917
2026-03-28 05:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c307ab0-839c-50fc-b200-ace68ac89656 with scrape type 2
2026-03-28 05:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c307ab0-839c-50fc-b200-ace68ac89656 with scrape type 2
2026-03-28 05:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c307ab0-839c-50fc-b200-ace68ac89656, identifier: ZJ78917
2026-03-28 05:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917
2026-03-28 05:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917
2026-03-28 05:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917 to the API
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:06Z',
 'fuel_type': 'diesel',
 'id': '5c307ab0-839c-50fc-b200-ace68ac89656',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ78917',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 188156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-10',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'automatic',
 'trim': 'Standard',
 'year': 2005}
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-28 05:34:30 [auto1.de] INFO: Saving data for ZJ78917: {'auction_closing_time': 1774716786.0, 'created_time': 1774550715.744846, 'last_price_update_time': 1774676070.821556}
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ78917') HTTP/1.1" 204 0
2026-03-28 05:34:30 [auto1.de] INFO: Found listing with ID: EB82059
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB82059%27 HTTP/1.1" 200 None
2026-03-28 05:34:30 [auto1.de] INFO: Scrape type for EB82059: 0
2026-03-28 05:34:30 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-28 05:34:30 [auto1.de] INFO: Scrape type for XA78994: 0
2026-03-28 05:34:30 [auto1.de] INFO: Found listing with ID: EB35688
2026-03-28 05:34:30 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-28 05:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:31 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:31 [auto1.de] INFO: Found listing with ID: VU26984
2026-03-28 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU26984%27 HTTP/1.1" 200 None
2026-03-28 05:34:31 [auto1.de] INFO: Scrape type for VU26984: 0
2026-03-28 05:34:31 [auto1.de] INFO: Found listing with ID: TM51786
2026-03-28 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM51786%27 HTTP/1.1" 200 None
2026-03-28 05:34:31 [auto1.de] INFO: Scrape type for TM51786: 0
2026-03-28 05:34:31 [auto1.de] INFO: Found listing with ID: JZ28158
2026-03-28 05:34:31 [auto1.de] INFO: Found listing with ID: LE56250
2026-03-28 05:34:31 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-28 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-28 05:34:31 [auto1.de] INFO: Scrape type for YA93761: 2
2026-03-28 05:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761
2026-03-28 05:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 258aa3c4-6137-5877-9069-b9a14fa8ce63 with scrape type 2
2026-03-28 05:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 258aa3c4-6137-5877-9069-b9a14fa8ce63 with scrape type 2
2026-03-28 05:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 258aa3c4-6137-5877-9069-b9a14fa8ce63, identifier: YA93761
2026-03-28 05:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761
2026-03-28 05:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761
2026-03-28 05:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761 to the API
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:53:13Z',
 'fuel_type': 'petrol',
 'id': '258aa3c4-6137-5877-9069-b9a14fa8ce63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA93761',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 238783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-18',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2018}
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Saving data for YA93761: {'auction_closing_time': 1774716793.0, 'created_time': 1774550490.082061, 'last_price_update_time': 1774676072.297834}
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA93761') HTTP/1.1" 204 0
2026-03-28 05:34:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Scrape type for AD50420: 0
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: TL04129
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: TT42996
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT42996%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Scrape type for TT42996: 2
2026-03-28 05:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40387942-ea80-5065-93fe-bc1f23ae8628 with identifier: TT42996
2026-03-28 05:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40387942-ea80-5065-93fe-bc1f23ae8628 with scrape type 2
2026-03-28 05:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40387942-ea80-5065-93fe-bc1f23ae8628 with scrape type 2
2026-03-28 05:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40387942-ea80-5065-93fe-bc1f23ae8628, identifier: TT42996
2026-03-28 05:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40387942-ea80-5065-93fe-bc1f23ae8628 with identifier: TT42996
2026-03-28 05:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40387942-ea80-5065-93fe-bc1f23ae8628 with identifier: TT42996
2026-03-28 05:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40387942-ea80-5065-93fe-bc1f23ae8628 with identifier: TT42996 to the API
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:34:27Z',
 'fuel_type': 'hybrid',
 'id': '40387942-ea80-5065-93fe-bc1f23ae8628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT42996',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 63845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-07',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT42996%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Saving data for TT42996: {'auction_closing_time': 1774715667.0, 'created_time': 1774467939.708671, 'last_price_update_time': 1774676072.867064}
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT42996') HTTP/1.1" 204 0
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Scrape type for BH40486: 0
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: TM28399
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: NG35588
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG35588%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Scrape type for NG35588: 0
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: DX26542
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Scrape type for XY68410: 0
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Scrape type for NC31400: 0
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: GW92568
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Scrape type for BT69693: 0
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW55395%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Scrape type for ZW55395: 0
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: SF00674
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: RP81387
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP81387%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Scrape type for RP81387: 0
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: KW54654
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW54654%27 HTTP/1.1" 200 None
2026-03-28 05:34:32 [auto1.de] INFO: Scrape type for KW54654: 0
2026-03-28 05:34:32 [auto1.de] INFO: Found listing with ID: CA74097
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA74097%27 HTTP/1.1" 200 None
2026-03-28 05:34:33 [auto1.de] INFO: Scrape type for CA74097: 0
2026-03-28 05:34:33 [auto1.de] INFO: Found listing with ID: US56828
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56828%27 HTTP/1.1" 200 None
2026-03-28 05:34:33 [auto1.de] INFO: Scrape type for US56828: 0
2026-03-28 05:34:33 [auto1.de] INFO: Found listing with ID: PL21406
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL21406%27 HTTP/1.1" 200 None
2026-03-28 05:34:33 [auto1.de] INFO: Scrape type for PL21406: 2
2026-03-28 05:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9448049-2dae-5021-be64-70e434d6600d with identifier: PL21406
2026-03-28 05:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9448049-2dae-5021-be64-70e434d6600d with scrape type 2
2026-03-28 05:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9448049-2dae-5021-be64-70e434d6600d with scrape type 2
2026-03-28 05:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9448049-2dae-5021-be64-70e434d6600d, identifier: PL21406
2026-03-28 05:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9448049-2dae-5021-be64-70e434d6600d with identifier: PL21406
2026-03-28 05:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9448049-2dae-5021-be64-70e434d6600d with identifier: PL21406
2026-03-28 05:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9448049-2dae-5021-be64-70e434d6600d with identifier: PL21406 to the API
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 475,
 'expiration_date': '2026-03-28T16:46:10Z',
 'fuel_type': 'petrol',
 'id': 'b9448049-2dae-5021-be64-70e434d6600d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL21406',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 124971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-17',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 63 AMG',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL21406%27 HTTP/1.1" 200 None
2026-03-28 05:34:33 [auto1.de] INFO: Saving data for PL21406: {'auction_closing_time': 1774716370.0, 'created_time': 1773513417.056107, 'last_price_update_time': 1774676073.461526}
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL21406') HTTP/1.1" 204 0
2026-03-28 05:34:33 [auto1.de] INFO: Found listing with ID: NK11674
2026-03-28 05:34:33 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-28 05:34:33 [auto1.de] INFO: Found listing with ID: YF83058
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83058%27 HTTP/1.1" 200 None
2026-03-28 05:34:33 [auto1.de] INFO: Scrape type for YF83058: 0
2026-03-28 05:34:33 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-28 05:34:33 [auto1.de] INFO: Scrape type for MT08770: 0
2026-03-28 05:34:33 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-28 05:34:33 [auto1.de] INFO: Scrape type for XS50752: 2
2026-03-28 05:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with identifier: XS50752
2026-03-28 05:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with scrape type 2
2026-03-28 05:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with scrape type 2
2026-03-28 05:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 907f5881-bdc7-56ab-a9e8-3755bdf0c496, identifier: XS50752
2026-03-28 05:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with identifier: XS50752
2026-03-28 05:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with identifier: XS50752
2026-03-28 05:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with identifier: XS50752 to the API
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:09:40Z',
 'fuel_type': 'diesel',
 'id': '907f5881-bdc7-56ab-a9e8-3755bdf0c496',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS50752',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 69276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2019}
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Saving data for XS50752: {'auction_closing_time': 1774714180.0, 'created_time': 1774552665.939813, 'last_price_update_time': 1774676074.023882}
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS50752') HTTP/1.1" 204 0
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: TS13333
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS13333%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for TS13333: 0
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for FM78793: 0
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: KL09374
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: LC07612
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC07612%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for LC07612: 0
2026-03-28 05:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:34 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: BC57293
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC57293%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for BC57293: 0
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for XK59182: 0
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: YS42401
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS42401%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for YS42401: 0
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: PF56750
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF56750%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for PF56750: 0
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: SS34696
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS34696%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for SS34696: 0
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: ED19877
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19877%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for ED19877: 0
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for ZC19539: 0
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: TP76478
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: YK76722
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK76722%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for YK76722: 0
2026-03-28 05:34:34 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-28 05:34:34 [auto1.de] INFO: Scrape type for VH44928: 2
2026-03-28 05:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928
2026-03-28 05:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 711a995d-0893-5aa5-82cd-de12efe91e1d with scrape type 2
2026-03-28 05:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 711a995d-0893-5aa5-82cd-de12efe91e1d with scrape type 2
2026-03-28 05:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 711a995d-0893-5aa5-82cd-de12efe91e1d, identifier: VH44928
2026-03-28 05:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928
2026-03-28 05:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928
2026-03-28 05:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928 to the API
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:02:05Z',
 'fuel_type': 'petrol',
 'id': '711a995d-0893-5aa5-82cd-de12efe91e1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH44928',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 91606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-04',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI Sound BlueMotion',
 'transmission': 'manual',
 'trim': 'Sound BlueMotion',
 'year': 2017}
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-28 05:34:35 [auto1.de] INFO: Saving data for VH44928: {'auction_closing_time': 1774713725.0, 'created_time': 1773741304.386548, 'last_price_update_time': 1774676075.397782}
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH44928') HTTP/1.1" 204 0
2026-03-28 05:34:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:35 [auto1.de] INFO: Found listing with ID: HN95943
2026-03-28 05:34:35 [auto1.de] INFO: Found listing with ID: FK01435
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK01435%27 HTTP/1.1" 200 None
2026-03-28 05:34:35 [auto1.de] INFO: Scrape type for FK01435: 0
2026-03-28 05:34:35 [auto1.de] INFO: Found listing with ID: SM97641
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM97641%27 HTTP/1.1" 200 None
2026-03-28 05:34:35 [auto1.de] INFO: Scrape type for SM97641: 0
2026-03-28 05:34:35 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-28 05:34:35 [auto1.de] INFO: Scrape type for GS84935: 2
2026-03-28 05:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935
2026-03-28 05:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 859b9249-7552-5854-8a32-db9638949e5f with scrape type 2
2026-03-28 05:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 859b9249-7552-5854-8a32-db9638949e5f with scrape type 2
2026-03-28 05:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 859b9249-7552-5854-8a32-db9638949e5f, identifier: GS84935
2026-03-28 05:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935
2026-03-28 05:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935
2026-03-28 05:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935 to the API
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:22:21Z',
 'fuel_type': 'diesel',
 'id': '859b9249-7552-5854-8a32-db9638949e5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS84935',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 135691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-17',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi Energy BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2017}
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-28 05:34:35 [auto1.de] INFO: Saving data for GS84935: {'auction_closing_time': 1774714941.0, 'created_time': 1773304057.930398, 'last_price_update_time': 1774676075.950126}
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS84935') HTTP/1.1" 204 0
2026-03-28 05:34:35 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-28 05:34:35 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-28 05:34:35 [auto1.de] INFO: Found listing with ID: RM36299
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM36299%27 HTTP/1.1" 200 None
2026-03-28 05:34:35 [auto1.de] INFO: Scrape type for RM36299: 0
2026-03-28 05:34:35 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-28 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-28 05:34:36 [auto1.de] INFO: Scrape type for ME12043: 2
2026-03-28 05:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42817da0-a9e4-5220-b540-7c68c34a95a3 with identifier: ME12043
2026-03-28 05:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42817da0-a9e4-5220-b540-7c68c34a95a3 with scrape type 2
2026-03-28 05:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42817da0-a9e4-5220-b540-7c68c34a95a3 with scrape type 2
2026-03-28 05:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42817da0-a9e4-5220-b540-7c68c34a95a3, identifier: ME12043
2026-03-28 05:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42817da0-a9e4-5220-b540-7c68c34a95a3 with identifier: ME12043
2026-03-28 05:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42817da0-a9e4-5220-b540-7c68c34a95a3 with identifier: ME12043
2026-03-28 05:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42817da0-a9e4-5220-b540-7c68c34a95a3 with identifier: ME12043 to the API
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:32:46Z',
 'fuel_type': 'petrol',
 'id': '42817da0-a9e4-5220-b540-7c68c34a95a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME12043',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 104297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-28 05:34:36 [auto1.de] INFO: Saving data for ME12043: {'auction_closing_time': 1774715566.0, 'created_time': 1773984693.363473, 'last_price_update_time': 1774676076.424178}
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME12043') HTTP/1.1" 204 0
2026-03-28 05:34:36 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-28 05:34:36 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-28 05:34:36 [auto1.de] INFO: Scrape type for SY16661: 2
2026-03-28 05:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661
2026-03-28 05:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with scrape type 2
2026-03-28 05:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with scrape type 2
2026-03-28 05:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa1ebb92-e712-5112-9e0a-45d63c1d0a53, identifier: SY16661
2026-03-28 05:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661
2026-03-28 05:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661
2026-03-28 05:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661 to the API
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:55:02Z',
 'fuel_type': 'petrol',
 'id': 'fa1ebb92-e712-5112-9e0a-45d63c1d0a53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY16661',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 154075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-13',
 'seller_name': None,
 'title': 'Opel Insignia 1.6 SIDI Turbo Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2015}
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-28 05:34:36 [auto1.de] INFO: Saving data for SY16661: {'auction_closing_time': 1774716902.0, 'created_time': 1774552932.970288, 'last_price_update_time': 1774676076.867071}
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY16661') HTTP/1.1" 204 0
2026-03-28 05:34:36 [auto1.de] INFO: Found listing with ID: MJ50234
2026-03-28 05:34:36 [auto1.de] INFO: Found listing with ID: WP19217
2026-03-28 05:34:36 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-28 05:34:36 [auto1.de] INFO: Scrape type for SC05662: 2
2026-03-28 05:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with identifier: SC05662
2026-03-28 05:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with scrape type 2
2026-03-28 05:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with scrape type 2
2026-03-28 05:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4acfa056-75ed-58a7-bafb-9aa92b5167b4, identifier: SC05662
2026-03-28 05:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with identifier: SC05662
2026-03-28 05:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with identifier: SC05662
2026-03-28 05:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with identifier: SC05662 to the API
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 370,
 'expiration_date': '2026-03-28T16:17:41Z',
 'fuel_type': 'petrol',
 'id': '4acfa056-75ed-58a7-bafb-9aa92b5167b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC05662',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stinger',
 'odometer': 135262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seller_name': None,
 'title': 'Kia Stinger 3.3 V6 TGDI GT 4WD',
 'transmission': 'automatic',
 'trim': 'GT 4WD',
 'year': 2018}
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-28 05:34:37 [auto1.de] INFO: Saving data for SC05662: {'auction_closing_time': 1774714661.0, 'created_time': 1774552923.738078, 'last_price_update_time': 1774676077.294045}
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC05662') HTTP/1.1" 204 0
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: GM22494
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM22494%27 HTTP/1.1" 200 None
2026-03-28 05:34:37 [auto1.de] INFO: Scrape type for GM22494: 0
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: WA51646
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: FX28267
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX28267%27 HTTP/1.1" 200 None
2026-03-28 05:34:37 [auto1.de] INFO: Scrape type for FX28267: 0
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: ZL47575
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: VG80520
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG80520%27 HTTP/1.1" 200 None
2026-03-28 05:34:37 [auto1.de] INFO: Scrape type for VG80520: 0
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-28 05:34:37 [auto1.de] INFO: Scrape type for VB40940: 0
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: EY08690
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: VE85769
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: LZ61913
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ61913%27 HTTP/1.1" 200 None
2026-03-28 05:34:37 [auto1.de] INFO: Scrape type for LZ61913: 2
2026-03-28 05:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d93665a4-2a1f-5b04-9020-444faead1c6f with identifier: LZ61913
2026-03-28 05:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93665a4-2a1f-5b04-9020-444faead1c6f with scrape type 2
2026-03-28 05:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d93665a4-2a1f-5b04-9020-444faead1c6f with scrape type 2
2026-03-28 05:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d93665a4-2a1f-5b04-9020-444faead1c6f, identifier: LZ61913
2026-03-28 05:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d93665a4-2a1f-5b04-9020-444faead1c6f with identifier: LZ61913
2026-03-28 05:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d93665a4-2a1f-5b04-9020-444faead1c6f with identifier: LZ61913
2026-03-28 05:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d93665a4-2a1f-5b04-9020-444faead1c6f with identifier: LZ61913 to the API
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:44:37Z',
 'fuel_type': 'petrol',
 'id': 'd93665a4-2a1f-5b04-9020-444faead1c6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ61913',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf III',
 'odometer': 56413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1993-08-01',
 'seller_name': None,
 'title': 'Volkswagen Golf III 1.6 CL',
 'transmission': 'manual',
 'trim': 'CL',
 'year': 1993}
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ61913%27 HTTP/1.1" 200 None
2026-03-28 05:34:37 [auto1.de] INFO: Saving data for LZ61913: {'auction_closing_time': 1774716277.0, 'created_time': 1774466007.754768, 'last_price_update_time': 1774676077.891038}
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ61913') HTTP/1.1" 204 0
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: XT31458
2026-03-28 05:34:37 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-28 05:34:37 [auto1.de] INFO: Scrape type for ZG52180: 2
2026-03-28 05:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49da4110-a21d-500f-8b3b-bb4f3514bd5d with identifier: ZG52180
2026-03-28 05:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49da4110-a21d-500f-8b3b-bb4f3514bd5d with scrape type 2
2026-03-28 05:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49da4110-a21d-500f-8b3b-bb4f3514bd5d with scrape type 2
2026-03-28 05:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49da4110-a21d-500f-8b3b-bb4f3514bd5d, identifier: ZG52180
2026-03-28 05:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49da4110-a21d-500f-8b3b-bb4f3514bd5d with identifier: ZG52180
2026-03-28 05:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49da4110-a21d-500f-8b3b-bb4f3514bd5d with identifier: ZG52180
2026-03-28 05:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49da4110-a21d-500f-8b3b-bb4f3514bd5d with identifier: ZG52180 to the API
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:05:30Z',
 'fuel_type': 'diesel',
 'id': '49da4110-a21d-500f-8b3b-bb4f3514bd5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG52180',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 262806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-23',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-28 05:34:38 [auto1.de] INFO: Saving data for ZG52180: {'auction_closing_time': 1774713930.0, 'created_time': 1774550427.406458, 'last_price_update_time': 1774676078.347341}
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG52180') HTTP/1.1" 204 0
2026-03-28 05:34:38 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-28 05:34:38 [auto1.de] INFO: Scrape type for HT24863: 2
2026-03-28 05:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with identifier: HT24863
2026-03-28 05:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with scrape type 2
2026-03-28 05:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with scrape type 2
2026-03-28 05:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c37f8d84-64f2-5833-b3d6-d6fa1f390e5e, identifier: HT24863
2026-03-28 05:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with identifier: HT24863
2026-03-28 05:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with identifier: HT24863
2026-03-28 05:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with identifier: HT24863 to the API
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-28T16:18:26Z',
 'fuel_type': 'diesel',
 'id': 'c37f8d84-64f2-5833-b3d6-d6fa1f390e5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT24863',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 170877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 300 d EDITION lang',
 'transmission': 'automatic',
 'trim': 'EDITION lang',
 'year': 2020}
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-28 05:34:38 [auto1.de] INFO: Saving data for HT24863: {'auction_closing_time': 1774714706.0, 'created_time': 1774551667.868716, 'last_price_update_time': 1774676078.877418}
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT24863') HTTP/1.1" 204 0
2026-03-28 05:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:39 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:39 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-28 05:34:39 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-28 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-28 05:34:39 [auto1.de] INFO: Scrape type for EU98596: 2
2026-03-28 05:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596
2026-03-28 05:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with scrape type 2
2026-03-28 05:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with scrape type 2
2026-03-28 05:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148, identifier: EU98596
2026-03-28 05:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596
2026-03-28 05:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596
2026-03-28 05:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596 to the API
2026-03-28 05:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-28T16:53:34Z',
 'fuel_type': 'diesel',
 'id': '8e70c1c9-40a0-5ab5-9cc7-470279c3c148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU98596',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 181848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 Multijet L2H2 RS: 3450 mm',
 'transmission': 'automatic',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2020}
2026-03-28 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-28 05:34:40 [auto1.de] INFO: Saving data for EU98596: {'auction_closing_time': 1774716814.0, 'created_time': 1773946413.761746, 'last_price_update_time': 1774676080.686839}
2026-03-28 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU98596') HTTP/1.1" 204 0
2026-03-28 05:34:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:40 [auto1.de] INFO: Found listing with ID: CW96220
2026-03-28 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96220%27 HTTP/1.1" 200 None
2026-03-28 05:34:40 [auto1.de] INFO: Scrape type for CW96220: 0
2026-03-28 05:34:40 [auto1.de] INFO: Found listing with ID: ZU82710
2026-03-28 05:34:40 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-28 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-28 05:34:40 [auto1.de] INFO: Scrape type for AZ05535: 2
2026-03-28 05:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535
2026-03-28 05:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a20cfbd8-21a1-517b-8f4c-760298d93660 with scrape type 2
2026-03-28 05:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a20cfbd8-21a1-517b-8f4c-760298d93660 with scrape type 2
2026-03-28 05:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a20cfbd8-21a1-517b-8f4c-760298d93660, identifier: AZ05535
2026-03-28 05:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535
2026-03-28 05:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535
2026-03-28 05:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535 to the API
2026-03-28 05:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 455,
 'expiration_date': '2026-03-28T16:47:24Z',
 'fuel_type': 'petrol',
 'id': 'a20cfbd8-21a1-517b-8f4c-760298d93660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ05535',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 95046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 500 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Saving data for AZ05535: {'auction_closing_time': 1774716444.0, 'created_time': 1774551038.547434, 'last_price_update_time': 1774676081.129769}
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ05535') HTTP/1.1" 204 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: EA35608
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA35608%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for EA35608: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: AL17067
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: WE17641
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: BP83751
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP83751%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for BP83751: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: NT96701
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for DP90284: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: AY92583
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: MP72809
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP72809%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for MP72809: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: KU29056
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: PB67262
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB67262%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for PB67262: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: DP65043
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP65043%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for DP65043: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: NN10939
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for FX25662: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: VF90818
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for YF48046: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: SR56375
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP68179%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for SP68179: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30949%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for ZL30949: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: XW98427
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: ML73813
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML73813%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for ML73813: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: HD49679
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: DC75837
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC75837%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for DC75837: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT65336%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for JT65336: 2
2026-03-28 05:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336
2026-03-28 05:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with scrape type 2
2026-03-28 05:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with scrape type 2
2026-03-28 05:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60a2ee00-9b33-5bee-9ed6-63b6175bf234, identifier: JT65336
2026-03-28 05:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336
2026-03-28 05:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336
2026-03-28 05:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336 to the API
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:10Z',
 'fuel_type': 'diesel',
 'id': '60a2ee00-9b33-5bee-9ed6-63b6175bf234',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT65336',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 180706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-21',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI United BlueMotion',
 'transmission': 'manual',
 'trim': 'United BlueMotion',
 'year': 2009}
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT65336%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Saving data for JT65336: {'auction_closing_time': 1774716070.0, 'created_time': 1773741502.894159, 'last_price_update_time': 1774676081.762493}
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT65336') HTTP/1.1" 204 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: GB09367
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB09367%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for GB09367: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: DK27317
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: WL60087
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL60087%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for WL60087: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: UD38277
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD38277%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for UD38277: 0
2026-03-28 05:34:41 [auto1.de] INFO: Found listing with ID: CR45674
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR45674%27 HTTP/1.1" 200 None
2026-03-28 05:34:41 [auto1.de] INFO: Scrape type for CR45674: 0
2026-03-28 05:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:43 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: FR24268
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: UT71403
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: LL49213
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: RM06492
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: MG91199
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: XB91426
2026-03-28 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91426%27 HTTP/1.1" 200 None
2026-03-28 05:34:43 [auto1.de] INFO: Scrape type for XB91426: 0
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: MC26208
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: GJ57760
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-28 05:34:43 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-28 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-28 05:34:43 [auto1.de] INFO: Scrape type for LX45168: 2
2026-03-28 05:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with identifier: LX45168
2026-03-28 05:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with scrape type 2
2026-03-28 05:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with scrape type 2
2026-03-28 05:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27cad707-89bf-54cd-b19f-3d12f0ad4dfc, identifier: LX45168
2026-03-28 05:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with identifier: LX45168
2026-03-28 05:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with identifier: LX45168
2026-03-28 05:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with identifier: LX45168 to the API
2026-03-28 05:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:23:26Z',
 'fuel_type': 'petrol',
 'id': '27cad707-89bf-54cd-b19f-3d12f0ad4dfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX45168',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 78850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-17',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-28 05:34:44 [auto1.de] INFO: Saving data for LX45168: {'auction_closing_time': 1774715006.0, 'created_time': 1774552629.582714, 'last_price_update_time': 1774676084.300947}
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX45168') HTTP/1.1" 204 0
2026-03-28 05:34:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:44 [auto1.de] INFO: Found listing with ID: GR60102
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR60102%27 HTTP/1.1" 200 None
2026-03-28 05:34:44 [auto1.de] INFO: Scrape type for GR60102: 0
2026-03-28 05:34:44 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF04397%27 HTTP/1.1" 200 None
2026-03-28 05:34:44 [auto1.de] INFO: Scrape type for EF04397: 0
2026-03-28 05:34:44 [auto1.de] INFO: Found listing with ID: XR86863
2026-03-28 05:34:44 [auto1.de] INFO: Found listing with ID: UW93574
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93574%27 HTTP/1.1" 200 None
2026-03-28 05:34:44 [auto1.de] INFO: Scrape type for UW93574: 2
2026-03-28 05:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2b7ae4c-de0a-546a-81de-246feada0016 with identifier: UW93574
2026-03-28 05:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2b7ae4c-de0a-546a-81de-246feada0016 with scrape type 2
2026-03-28 05:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2b7ae4c-de0a-546a-81de-246feada0016 with scrape type 2
2026-03-28 05:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2b7ae4c-de0a-546a-81de-246feada0016, identifier: UW93574
2026-03-28 05:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2b7ae4c-de0a-546a-81de-246feada0016 with identifier: UW93574
2026-03-28 05:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2b7ae4c-de0a-546a-81de-246feada0016 with identifier: UW93574
2026-03-28 05:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2b7ae4c-de0a-546a-81de-246feada0016 with identifier: UW93574 to the API
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:23Z',
 'fuel_type': 'diesel',
 'id': 'd2b7ae4c-de0a-546a-81de-246feada0016',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW93574',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 128729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93574%27 HTTP/1.1" 200 None
2026-03-28 05:34:44 [auto1.de] INFO: Saving data for UW93574: {'auction_closing_time': 1774716323.0, 'created_time': 1774466951.915391, 'last_price_update_time': 1774676084.860156}
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW93574') HTTP/1.1" 204 0
2026-03-28 05:34:44 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-28 05:34:44 [auto1.de] INFO: Found listing with ID: MX91312
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX91312%27 HTTP/1.1" 200 None
2026-03-28 05:34:44 [auto1.de] INFO: Scrape type for MX91312: 0
2026-03-28 05:34:44 [auto1.de] INFO: Found listing with ID: JY81419
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY81419%27 HTTP/1.1" 200 None
2026-03-28 05:34:44 [auto1.de] INFO: Scrape type for JY81419: 0
2026-03-28 05:34:44 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-28 05:34:44 [auto1.de] INFO: Scrape type for PS82171: 2
2026-03-28 05:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043989f6-023f-522c-bbc9-56db35571a0b with identifier: PS82171
2026-03-28 05:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043989f6-023f-522c-bbc9-56db35571a0b with scrape type 2
2026-03-28 05:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043989f6-023f-522c-bbc9-56db35571a0b with scrape type 2
2026-03-28 05:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 043989f6-023f-522c-bbc9-56db35571a0b, identifier: PS82171
2026-03-28 05:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 043989f6-023f-522c-bbc9-56db35571a0b with identifier: PS82171
2026-03-28 05:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 043989f6-023f-522c-bbc9-56db35571a0b with identifier: PS82171
2026-03-28 05:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 043989f6-023f-522c-bbc9-56db35571a0b with identifier: PS82171 to the API
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:31:22Z',
 'fuel_type': 'petrol',
 'id': '043989f6-023f-522c-bbc9-56db35571a0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS82171',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 132907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seller_name': None,
 'title': 'BMW X2 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-28 05:34:45 [auto1.de] INFO: Saving data for PS82171: {'auction_closing_time': 1774715482.0, 'created_time': 1774550667.487161, 'last_price_update_time': 1774676085.319301}
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS82171') HTTP/1.1" 204 0
2026-03-28 05:34:45 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-28 05:34:45 [auto1.de] INFO: Scrape type for JM51025: 2
2026-03-28 05:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with identifier: JM51025
2026-03-28 05:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with scrape type 2
2026-03-28 05:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with scrape type 2
2026-03-28 05:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc, identifier: JM51025
2026-03-28 05:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with identifier: JM51025
2026-03-28 05:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with identifier: JM51025
2026-03-28 05:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with identifier: JM51025 to the API
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:31:53Z',
 'fuel_type': 'petrol',
 'id': '09b0bba0-a9c5-59eb-b04c-b88e96d18cfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM51025',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 57146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-18',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-28 05:34:45 [auto1.de] INFO: Saving data for JM51025: {'auction_closing_time': 1774715513.0, 'created_time': 1774551231.436923, 'last_price_update_time': 1774676085.746773}
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM51025') HTTP/1.1" 204 0
2026-03-28 05:34:45 [auto1.de] INFO: Found listing with ID: EZ23867
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ23867%27 HTTP/1.1" 200 None
2026-03-28 05:34:45 [auto1.de] INFO: Scrape type for EZ23867: 0
2026-03-28 05:34:45 [auto1.de] INFO: Found listing with ID: FA60427
2026-03-28 05:34:45 [auto1.de] INFO: Found listing with ID: KD74504
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD74504%27 HTTP/1.1" 200 None
2026-03-28 05:34:45 [auto1.de] INFO: Scrape type for KD74504: 0
2026-03-28 05:34:45 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-28 05:34:45 [auto1.de] INFO: Scrape type for LE46493: 2
2026-03-28 05:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493
2026-03-28 05:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with scrape type 2
2026-03-28 05:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with scrape type 2
2026-03-28 05:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c, identifier: LE46493
2026-03-28 05:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493
2026-03-28 05:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493
2026-03-28 05:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493 to the API
2026-03-28 05:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:57:48Z',
 'fuel_type': 'petrol',
 'id': '06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE46493',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 139206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-02',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Intro Edition 2WD',
 'transmission': 'manual',
 'trim': 'Intro Edition 2WD',
 'year': 2011}
2026-03-28 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-28 05:34:46 [auto1.de] INFO: Saving data for LE46493: {'auction_closing_time': 1774717068.0, 'created_time': 1774550436.507507, 'last_price_update_time': 1774676086.7922}
2026-03-28 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE46493') HTTP/1.1" 204 0
2026-03-28 05:34:46 [auto1.de] INFO: Found listing with ID: RK40243
2026-03-28 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40243%27 HTTP/1.1" 200 None
2026-03-28 05:34:46 [auto1.de] INFO: Scrape type for RK40243: 0
2026-03-28 05:34:46 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-28 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-28 05:34:46 [auto1.de] INFO: Scrape type for PJ34004: 2
2026-03-28 05:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004
2026-03-28 05:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with scrape type 2
2026-03-28 05:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with scrape type 2
2026-03-28 05:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9, identifier: PJ34004
2026-03-28 05:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004
2026-03-28 05:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004
2026-03-28 05:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004 to the API
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-28T16:41:37Z',
 'fuel_type': 'petrol',
 'id': 'f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ34004',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 27315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-19',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.0 Turbo Ti Q4',
 'transmission': 'automatic',
 'trim': 'Ti Q4',
 'year': 2024}
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-28 05:34:47 [auto1.de] INFO: Saving data for PJ34004: {'auction_closing_time': 1774716097.0, 'created_time': 1773945651.002095, 'last_price_update_time': 1774676087.329641}
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ34004') HTTP/1.1" 204 0
2026-03-28 05:34:47 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-28 05:34:47 [auto1.de] INFO: Found listing with ID: EC42355
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC42355%27 HTTP/1.1" 200 None
2026-03-28 05:34:47 [auto1.de] INFO: Scrape type for EC42355: 0
2026-03-28 05:34:47 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-28 05:34:47 [auto1.de] INFO: Scrape type for LT09542: 2
2026-03-28 05:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542
2026-03-28 05:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with scrape type 2
2026-03-28 05:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with scrape type 2
2026-03-28 05:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1, identifier: LT09542
2026-03-28 05:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542
2026-03-28 05:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542
2026-03-28 05:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542 to the API
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:29Z',
 'fuel_type': 'diesel',
 'id': 'eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT09542',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'L 200',
 'odometer': 66378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-24',
 'seller_name': None,
 'title': 'Mitsubishi L 200 2.2 DI-D Intro Edition Doppelkabine 4WD',
 'transmission': 'manual',
 'trim': 'Intro Edition Doppelkabine 4WD',
 'year': 2021}
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-28 05:34:47 [auto1.de] INFO: Saving data for LT09542: {'auction_closing_time': 1774716389.0, 'created_time': 1774552104.025224, 'last_price_update_time': 1774676087.766268}
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT09542') HTTP/1.1" 204 0
2026-03-28 05:34:47 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY11970%27 HTTP/1.1" 200 None
2026-03-28 05:34:47 [auto1.de] INFO: Scrape type for GY11970: 0
2026-03-28 05:34:47 [auto1.de] INFO: Found listing with ID: YS11001
2026-03-28 05:34:47 [auto1.de] INFO: Found listing with ID: WP33305
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP33305%27 HTTP/1.1" 200 None
2026-03-28 05:34:47 [auto1.de] INFO: Scrape type for WP33305: 0
2026-03-28 05:34:47 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU76386%27 HTTP/1.1" 200 None
2026-03-28 05:34:47 [auto1.de] INFO: Scrape type for BU76386: 0
2026-03-28 05:34:47 [auto1.de] INFO: Found listing with ID: SC67475
2026-03-28 05:34:47 [auto1.de] INFO: Found listing with ID: JK59865
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK59865%27 HTTP/1.1" 200 None
2026-03-28 05:34:47 [auto1.de] INFO: Scrape type for JK59865: 0
2026-03-28 05:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:47 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:47 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-28 05:34:47 [auto1.de] INFO: Scrape type for JN76212: 2
2026-03-28 05:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212
2026-03-28 05:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with scrape type 2
2026-03-28 05:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with scrape type 2
2026-03-28 05:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10f9984f-742a-51a3-a9f2-7a2c07858cd7, identifier: JN76212
2026-03-28 05:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212
2026-03-28 05:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212
2026-03-28 05:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212 to the API
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:58:44Z',
 'fuel_type': 'petrol',
 'id': '10f9984f-742a-51a3-a9f2-7a2c07858cd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN76212',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 88108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-18',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2019}
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-28 05:34:48 [auto1.de] INFO: Saving data for JN76212: {'auction_closing_time': 1774717124.0, 'created_time': 1774552713.299455, 'last_price_update_time': 1774676088.40611}
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN76212') HTTP/1.1" 204 0
2026-03-28 05:34:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:48 [auto1.de] INFO: Found listing with ID: JJ18730
2026-03-28 05:34:48 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-28 05:34:48 [auto1.de] INFO: Scrape type for RZ53370: 2
2026-03-28 05:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370
2026-03-28 05:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af2b8648-900e-5999-addd-3e659c7d098c with scrape type 2
2026-03-28 05:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af2b8648-900e-5999-addd-3e659c7d098c with scrape type 2
2026-03-28 05:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af2b8648-900e-5999-addd-3e659c7d098c, identifier: RZ53370
2026-03-28 05:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370
2026-03-28 05:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370
2026-03-28 05:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370 to the API
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:40:57Z',
 'fuel_type': 'petrol',
 'id': 'af2b8648-900e-5999-addd-3e659c7d098c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ53370',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 102589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-30',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-28 05:34:48 [auto1.de] INFO: Saving data for RZ53370: {'auction_closing_time': 1774716057.0, 'created_time': 1774553029.767081, 'last_price_update_time': 1774676088.926344}
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ53370') HTTP/1.1" 204 0
2026-03-28 05:34:48 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-28 05:34:48 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-28 05:34:48 [auto1.de] INFO: Found listing with ID: VT29365
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT29365%27 HTTP/1.1" 200 None
2026-03-28 05:34:48 [auto1.de] INFO: Scrape type for VT29365: 2
2026-03-28 05:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c143b34-326e-5d9b-847b-6152b80a3d73 with identifier: VT29365
2026-03-28 05:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c143b34-326e-5d9b-847b-6152b80a3d73 with scrape type 2
2026-03-28 05:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c143b34-326e-5d9b-847b-6152b80a3d73 with scrape type 2
2026-03-28 05:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c143b34-326e-5d9b-847b-6152b80a3d73, identifier: VT29365
2026-03-28 05:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c143b34-326e-5d9b-847b-6152b80a3d73 with identifier: VT29365
2026-03-28 05:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c143b34-326e-5d9b-847b-6152b80a3d73 with identifier: VT29365
2026-03-28 05:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c143b34-326e-5d9b-847b-6152b80a3d73 with identifier: VT29365 to the API
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:43:41Z',
 'fuel_type': 'petrol',
 'id': '8c143b34-326e-5d9b-847b-6152b80a3d73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT29365',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 106270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-16',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 EcoBoost Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2016}
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT29365%27 HTTP/1.1" 200 None
2026-03-28 05:34:49 [auto1.de] INFO: Saving data for VT29365: {'auction_closing_time': 1774716221.0, 'created_time': 1774468074.528612, 'last_price_update_time': 1774676089.377833}
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT29365') HTTP/1.1" 204 0
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: LR25618
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: VZ74394
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-28 05:34:49 [auto1.de] INFO: Scrape type for EW54456: 0
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-28 05:34:49 [auto1.de] INFO: Scrape type for UD63369: 2
2026-03-28 05:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with identifier: UD63369
2026-03-28 05:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with scrape type 2
2026-03-28 05:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with scrape type 2
2026-03-28 05:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45cc50fc-0541-5bc7-9635-156f87a5d7c6, identifier: UD63369
2026-03-28 05:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with identifier: UD63369
2026-03-28 05:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with identifier: UD63369
2026-03-28 05:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with identifier: UD63369 to the API
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:07:28Z',
 'fuel_type': 'diesel',
 'id': '45cc50fc-0541-5bc7-9635-156f87a5d7c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD63369',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 128211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-28 05:34:49 [auto1.de] INFO: Saving data for UD63369: {'auction_closing_time': 1774714048.0, 'created_time': 1774550663.756162, 'last_price_update_time': 1774676089.827098}
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD63369') HTTP/1.1" 204 0
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: NE03799
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: VX61126
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: LA58021
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-28 05:34:49 [auto1.de] INFO: Scrape type for YM60509: 0
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-28 05:34:49 [auto1.de] INFO: Scrape type for WA68072: 0
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: MP73357
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP73357%27 HTTP/1.1" 200 None
2026-03-28 05:34:49 [auto1.de] INFO: Scrape type for MP73357: 0
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: AH41759
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH41759%27 HTTP/1.1" 200 None
2026-03-28 05:34:49 [auto1.de] INFO: Scrape type for AH41759: 0
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: FW28639
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: KD39094
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD39094%27 HTTP/1.1" 200 None
2026-03-28 05:34:49 [auto1.de] INFO: Scrape type for KD39094: 0
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: PL18680
2026-03-28 05:34:49 [auto1.de] INFO: Found listing with ID: GB96559
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB96559%27 HTTP/1.1" 200 None
2026-03-28 05:34:49 [auto1.de] INFO: Scrape type for GB96559: 2
2026-03-28 05:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a845f4f6-2909-5169-ba7b-af05d3c02da5 with identifier: GB96559
2026-03-28 05:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a845f4f6-2909-5169-ba7b-af05d3c02da5 with scrape type 2
2026-03-28 05:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a845f4f6-2909-5169-ba7b-af05d3c02da5 with scrape type 2
2026-03-28 05:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a845f4f6-2909-5169-ba7b-af05d3c02da5, identifier: GB96559
2026-03-28 05:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a845f4f6-2909-5169-ba7b-af05d3c02da5 with identifier: GB96559
2026-03-28 05:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a845f4f6-2909-5169-ba7b-af05d3c02da5 with identifier: GB96559
2026-03-28 05:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a845f4f6-2909-5169-ba7b-af05d3c02da5 with identifier: GB96559 to the API
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:12:39Z',
 'fuel_type': 'petrol',
 'id': 'a845f4f6-2909-5169-ba7b-af05d3c02da5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB96559',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 72150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-15',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Kasten BlueMotion',
 'year': 2017}
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB96559%27 HTTP/1.1" 200 None
2026-03-28 05:34:50 [auto1.de] INFO: Saving data for GB96559: {'auction_closing_time': 1774714359.0, 'created_time': 1773345090.456744, 'last_price_update_time': 1774676090.354682}
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB96559') HTTP/1.1" 204 0
2026-03-28 05:34:50 [auto1.de] INFO: Found listing with ID: WG34535
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG34535%27 HTTP/1.1" 200 None
2026-03-28 05:34:50 [auto1.de] INFO: Scrape type for WG34535: 0
2026-03-28 05:34:50 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-28 05:34:50 [auto1.de] INFO: Found listing with ID: VJ37696
2026-03-28 05:34:50 [auto1.de] INFO: Found listing with ID: KB53133
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB53133%27 HTTP/1.1" 200 None
2026-03-28 05:34:50 [auto1.de] INFO: Scrape type for KB53133: 0
2026-03-28 05:34:50 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-28 05:34:50 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-28 05:34:50 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-28 05:34:50 [auto1.de] INFO: Scrape type for HP53076: 2
2026-03-28 05:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03c4bca-091b-5a07-bfb2-8215642a9d72 with identifier: HP53076
2026-03-28 05:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03c4bca-091b-5a07-bfb2-8215642a9d72 with scrape type 2
2026-03-28 05:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03c4bca-091b-5a07-bfb2-8215642a9d72 with scrape type 2
2026-03-28 05:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b03c4bca-091b-5a07-bfb2-8215642a9d72, identifier: HP53076
2026-03-28 05:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b03c4bca-091b-5a07-bfb2-8215642a9d72 with identifier: HP53076
2026-03-28 05:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b03c4bca-091b-5a07-bfb2-8215642a9d72 with identifier: HP53076
2026-03-28 05:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b03c4bca-091b-5a07-bfb2-8215642a9d72 with identifier: HP53076 to the API
2026-03-28 05:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:03:36Z',
 'fuel_type': 'diesel',
 'id': 'b03c4bca-091b-5a07-bfb2-8215642a9d72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP53076',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 247653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-27',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-28 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-28 05:34:51 [auto1.de] INFO: Saving data for HP53076: {'auction_closing_time': 1774713816.0, 'created_time': 1774552626.239979, 'last_price_update_time': 1774676091.824102}
2026-03-28 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP53076') HTTP/1.1" 204 0
2026-03-28 05:34:51 [auto1.de] INFO: Found listing with ID: ZX35425
2026-03-28 05:34:51 [auto1.de] INFO: Found listing with ID: PJ24227
2026-03-28 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ24227%27 HTTP/1.1" 200 None
2026-03-28 05:34:51 [auto1.de] INFO: Scrape type for PJ24227: 0
2026-03-28 05:34:51 [auto1.de] INFO: Found listing with ID: PX70527
2026-03-28 05:34:51 [auto1.de] INFO: Found listing with ID: JL65516
2026-03-28 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65516%27 HTTP/1.1" 200 None
2026-03-28 05:34:51 [auto1.de] INFO: Scrape type for JL65516: 0
2026-03-28 05:34:51 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-28 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-28 05:34:51 [auto1.de] INFO: Scrape type for SS68419: 2
2026-03-28 05:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8019f072-9d8b-5d9e-ad0f-ee821a136852 with identifier: SS68419
2026-03-28 05:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8019f072-9d8b-5d9e-ad0f-ee821a136852 with scrape type 2
2026-03-28 05:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8019f072-9d8b-5d9e-ad0f-ee821a136852 with scrape type 2
2026-03-28 05:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8019f072-9d8b-5d9e-ad0f-ee821a136852, identifier: SS68419
2026-03-28 05:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8019f072-9d8b-5d9e-ad0f-ee821a136852 with identifier: SS68419
2026-03-28 05:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8019f072-9d8b-5d9e-ad0f-ee821a136852 with identifier: SS68419
2026-03-28 05:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8019f072-9d8b-5d9e-ad0f-ee821a136852 with identifier: SS68419 to the API
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-28T16:16:45Z',
 'fuel_type': 'petrol',
 'id': '8019f072-9d8b-5d9e-ad0f-ee821a136852',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS68419',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 80554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-26',
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Energy Crossborder',
 'transmission': 'automatic',
 'trim': 'Crossborder',
 'year': 2017}
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-28 05:34:52 [auto1.de] INFO: Saving data for SS68419: {'auction_closing_time': 1774714605.0, 'created_time': 1774552450.315299, 'last_price_update_time': 1774676092.289306}
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS68419') HTTP/1.1" 204 0
2026-03-28 05:34:52 [auto1.de] INFO: Found listing with ID: DH25431
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH25431%27 HTTP/1.1" 200 None
2026-03-28 05:34:52 [auto1.de] INFO: Scrape type for DH25431: 2
2026-03-28 05:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f21f7ac-3b7d-5544-913d-a2945f45bdbc with identifier: DH25431
2026-03-28 05:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f21f7ac-3b7d-5544-913d-a2945f45bdbc with scrape type 2
2026-03-28 05:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f21f7ac-3b7d-5544-913d-a2945f45bdbc with scrape type 2
2026-03-28 05:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f21f7ac-3b7d-5544-913d-a2945f45bdbc, identifier: DH25431
2026-03-28 05:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f21f7ac-3b7d-5544-913d-a2945f45bdbc with identifier: DH25431
2026-03-28 05:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f21f7ac-3b7d-5544-913d-a2945f45bdbc with identifier: DH25431
2026-03-28 05:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f21f7ac-3b7d-5544-913d-a2945f45bdbc with identifier: DH25431 to the API
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 370,
 'expiration_date': '2026-03-28T16:20:43Z',
 'fuel_type': 'petrol',
 'id': '7f21f7ac-3b7d-5544-913d-a2945f45bdbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH25431',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 60074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'BMW 2er M2',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH25431%27 HTTP/1.1" 200 None
2026-03-28 05:34:52 [auto1.de] INFO: Saving data for DH25431: {'auction_closing_time': 1774714843.0, 'created_time': 1774550272.269261, 'last_price_update_time': 1774676092.818548}
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH25431') HTTP/1.1" 204 0
2026-03-28 05:34:52 [auto1.de] INFO: Found listing with ID: XC99684
2026-03-28 05:34:52 [auto1.de] INFO: Found listing with ID: SN64642
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN64642%27 HTTP/1.1" 200 None
2026-03-28 05:34:52 [auto1.de] INFO: Scrape type for SN64642: 0
2026-03-28 05:34:52 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-28 05:34:52 [auto1.de] INFO: Found listing with ID: NT23375
2026-03-28 05:34:52 [auto1.de] INFO: Found listing with ID: AV48521
2026-03-28 05:34:52 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-28 05:34:52 [auto1.de] INFO: Scrape type for RC84625: 2
2026-03-28 05:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with identifier: RC84625
2026-03-28 05:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with scrape type 2
2026-03-28 05:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with scrape type 2
2026-03-28 05:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d76da2a2-8d5c-5308-8cf3-b340b32cf1a8, identifier: RC84625
2026-03-28 05:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with identifier: RC84625
2026-03-28 05:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with identifier: RC84625
2026-03-28 05:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with identifier: RC84625 to the API
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:00:57Z',
 'fuel_type': 'petrol',
 'id': 'd76da2a2-8d5c-5308-8cf3-b340b32cf1a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC84625',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 10871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-15',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2024}
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-28 05:34:53 [auto1.de] INFO: Saving data for RC84625: {'auction_closing_time': 1774713657.0, 'created_time': 1774552876.275173, 'last_price_update_time': 1774676093.288046}
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC84625') HTTP/1.1" 204 0
2026-03-28 05:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:53 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:53 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-28 05:34:53 [auto1.de] INFO: Found listing with ID: CP53308
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP53308%27 HTTP/1.1" 200 None
2026-03-28 05:34:53 [auto1.de] INFO: Scrape type for CP53308: 2
2026-03-28 05:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 766c4042-6020-5302-8b81-28f0fe7e25ec with identifier: CP53308
2026-03-28 05:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 766c4042-6020-5302-8b81-28f0fe7e25ec with scrape type 2
2026-03-28 05:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 766c4042-6020-5302-8b81-28f0fe7e25ec with scrape type 2
2026-03-28 05:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 766c4042-6020-5302-8b81-28f0fe7e25ec, identifier: CP53308
2026-03-28 05:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 766c4042-6020-5302-8b81-28f0fe7e25ec with identifier: CP53308
2026-03-28 05:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 766c4042-6020-5302-8b81-28f0fe7e25ec with identifier: CP53308
2026-03-28 05:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 766c4042-6020-5302-8b81-28f0fe7e25ec with identifier: CP53308 to the API
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:53:02Z',
 'fuel_type': 'diesel',
 'id': '766c4042-6020-5302-8b81-28f0fe7e25ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP53308',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 138889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-08',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d kompakt Edition Score',
 'transmission': 'automatic',
 'trim': 'kompakt Edition Score',
 'year': 2016}
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP53308%27 HTTP/1.1" 200 None
2026-03-28 05:34:53 [auto1.de] INFO: Saving data for CP53308: {'auction_closing_time': 1774716782.0, 'created_time': 1773345042.538664, 'last_price_update_time': 1774676093.855734}
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP53308') HTTP/1.1" 204 0
2026-03-28 05:34:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:53 [auto1.de] INFO: Found listing with ID: RP45583
2026-03-28 05:34:53 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-28 05:34:53 [auto1.de] INFO: Scrape type for KF64937: 2
2026-03-28 05:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937
2026-03-28 05:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with scrape type 2
2026-03-28 05:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with scrape type 2
2026-03-28 05:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59, identifier: KF64937
2026-03-28 05:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937
2026-03-28 05:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937
2026-03-28 05:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937 to the API
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:00:22Z',
 'fuel_type': 'diesel',
 'id': '3b0c6ebc-3f12-5971-a90e-87ceb166ad59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF64937',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 111148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-25',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-28 05:34:54 [auto1.de] INFO: Saving data for KF64937: {'auction_closing_time': 1774713622.0, 'created_time': 1773226720.255274, 'last_price_update_time': 1774676094.837595}
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF64937') HTTP/1.1" 204 0
2026-03-28 05:34:54 [auto1.de] INFO: Found listing with ID: VC17090
2026-03-28 05:34:54 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-28 05:34:54 [auto1.de] INFO: Found listing with ID: KV09163
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV09163%27 HTTP/1.1" 200 None
2026-03-28 05:34:54 [auto1.de] INFO: Scrape type for KV09163: 0
2026-03-28 05:34:54 [auto1.de] INFO: Found listing with ID: VG95526
2026-03-28 05:34:54 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-28 05:34:54 [auto1.de] INFO: Found listing with ID: EC98631
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC98631%27 HTTP/1.1" 200 None
2026-03-28 05:34:54 [auto1.de] INFO: Scrape type for EC98631: 0
2026-03-28 05:34:54 [auto1.de] INFO: Found listing with ID: GG51597
2026-03-28 05:34:54 [auto1.de] INFO: Found listing with ID: FN83221
2026-03-28 05:34:54 [auto1.de] INFO: Found listing with ID: FV69098
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV69098%27 HTTP/1.1" 200 None
2026-03-28 05:34:54 [auto1.de] INFO: Scrape type for FV69098: 0
2026-03-28 05:34:54 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-28 05:34:55 [auto1.de] INFO: Scrape type for UU35907: 0
2026-03-28 05:34:55 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-28 05:34:55 [auto1.de] INFO: Scrape type for DX01657: 2
2026-03-28 05:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657
2026-03-28 05:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88730801-e705-5c42-a028-601e950fcf63 with scrape type 2
2026-03-28 05:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88730801-e705-5c42-a028-601e950fcf63 with scrape type 2
2026-03-28 05:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88730801-e705-5c42-a028-601e950fcf63, identifier: DX01657
2026-03-28 05:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657
2026-03-28 05:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657
2026-03-28 05:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657 to the API
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:49:23Z',
 'fuel_type': 'hybrid',
 'id': '88730801-e705-5c42-a028-601e950fcf63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX01657',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 161770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-14',
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.8 Hybrid Life+',
 'transmission': 'automatic',
 'trim': 'Life+',
 'year': 2013}
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-28 05:34:55 [auto1.de] INFO: Saving data for DX01657: {'auction_closing_time': 1774716563.0, 'created_time': 1773916814.054608, 'last_price_update_time': 1774676095.420999}
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX01657') HTTP/1.1" 204 0
2026-03-28 05:34:55 [auto1.de] INFO: Found listing with ID: CL15351
2026-03-28 05:34:55 [auto1.de] INFO: Found listing with ID: FD13282
2026-03-28 05:34:55 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-28 05:34:55 [auto1.de] INFO: Scrape type for XM82116: 2
2026-03-28 05:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116
2026-03-28 05:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca2bf380-4b4f-5d58-98f9-2209433faafb with scrape type 2
2026-03-28 05:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca2bf380-4b4f-5d58-98f9-2209433faafb with scrape type 2
2026-03-28 05:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca2bf380-4b4f-5d58-98f9-2209433faafb, identifier: XM82116
2026-03-28 05:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116
2026-03-28 05:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116
2026-03-28 05:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116 to the API
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:58:09Z',
 'fuel_type': 'diesel',
 'id': 'ca2bf380-4b4f-5d58-98f9-2209433faafb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM82116',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 227755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-05',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-28 05:34:55 [auto1.de] INFO: Saving data for XM82116: {'auction_closing_time': 1774717089.0, 'created_time': 1774551775.279452, 'last_price_update_time': 1774676095.954274}
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM82116') HTTP/1.1" 204 0
2026-03-28 05:34:55 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-28 05:34:55 [auto1.de] INFO: Found listing with ID: HS47507
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS47507%27 HTTP/1.1" 200 None
2026-03-28 05:34:55 [auto1.de] INFO: Scrape type for HS47507: 0
2026-03-28 05:34:55 [auto1.de] INFO: Found listing with ID: UY83334
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY83334%27 HTTP/1.1" 200 None
2026-03-28 05:34:56 [auto1.de] INFO: Scrape type for UY83334: 0
2026-03-28 05:34:56 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-28 05:34:56 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-28 05:34:56 [auto1.de] INFO: Scrape type for RJ76690: 2
2026-03-28 05:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690
2026-03-28 05:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with scrape type 2
2026-03-28 05:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with scrape type 2
2026-03-28 05:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0, identifier: RJ76690
2026-03-28 05:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690
2026-03-28 05:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690
2026-03-28 05:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690 to the API
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:39:58Z',
 'fuel_type': 'petrol',
 'id': '28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ76690',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 53943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-28 05:34:56 [auto1.de] INFO: Saving data for RJ76690: {'auction_closing_time': 1774715998.0, 'created_time': 1774552305.477944, 'last_price_update_time': 1774676096.433133}
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ76690') HTTP/1.1" 204 0
2026-03-28 05:34:56 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-28 05:34:56 [auto1.de] INFO: Found listing with ID: VC02899
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC02899%27 HTTP/1.1" 200 None
2026-03-28 05:34:56 [auto1.de] INFO: Scrape type for VC02899: 0
2026-03-28 05:34:56 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-28 05:34:56 [auto1.de] INFO: Scrape type for FM53272: 2
2026-03-28 05:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272
2026-03-28 05:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with scrape type 2
2026-03-28 05:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with scrape type 2
2026-03-28 05:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec, identifier: FM53272
2026-03-28 05:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272
2026-03-28 05:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272
2026-03-28 05:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272 to the API
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:33Z',
 'fuel_type': 'petrol',
 'id': '2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM53272',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 136115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-29',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-28 05:34:56 [auto1.de] INFO: Saving data for FM53272: {'auction_closing_time': 1774716453.0, 'created_time': 1774553014.077737, 'last_price_update_time': 1774676096.863802}
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM53272') HTTP/1.1" 204 0
2026-03-28 05:34:56 [auto1.de] INFO: Found listing with ID: CP21456
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP21456%27 HTTP/1.1" 200 None
2026-03-28 05:34:56 [auto1.de] INFO: Scrape type for CP21456: 0
2026-03-28 05:34:56 [auto1.de] INFO: Found listing with ID: RB81388
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81388%27 HTTP/1.1" 200 None
2026-03-28 05:34:56 [auto1.de] INFO: Scrape type for RB81388: 0
2026-03-28 05:34:56 [auto1.de] INFO: Found listing with ID: TJ40374
2026-03-28 05:34:56 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-28 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-28 05:34:57 [auto1.de] INFO: Scrape type for GL23432: 2
2026-03-28 05:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with identifier: GL23432
2026-03-28 05:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with scrape type 2
2026-03-28 05:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with scrape type 2
2026-03-28 05:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9591047-a5c8-53e7-a541-fdb2f4fe8b82, identifier: GL23432
2026-03-28 05:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with identifier: GL23432
2026-03-28 05:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with identifier: GL23432
2026-03-28 05:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with identifier: GL23432 to the API
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:14:35Z',
 'fuel_type': 'diesel',
 'id': 'b9591047-a5c8-53e7-a541-fdb2f4fe8b82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL23432',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 206230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2012}
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-28 05:34:57 [auto1.de] INFO: Saving data for GL23432: {'auction_closing_time': 1774714475.0, 'created_time': 1774550764.021375, 'last_price_update_time': 1774676097.423229}
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL23432') HTTP/1.1" 204 0
2026-03-28 05:34:57 [auto1.de] INFO: Found listing with ID: BJ59034
2026-03-28 05:34:57 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-28 05:34:57 [auto1.de] INFO: Scrape type for KZ61437: 2
2026-03-28 05:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3008db6f-3f31-5528-9f7c-6c162deb58c5 with identifier: KZ61437
2026-03-28 05:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3008db6f-3f31-5528-9f7c-6c162deb58c5 with scrape type 2
2026-03-28 05:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3008db6f-3f31-5528-9f7c-6c162deb58c5 with scrape type 2
2026-03-28 05:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3008db6f-3f31-5528-9f7c-6c162deb58c5, identifier: KZ61437
2026-03-28 05:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3008db6f-3f31-5528-9f7c-6c162deb58c5 with identifier: KZ61437
2026-03-28 05:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3008db6f-3f31-5528-9f7c-6c162deb58c5 with identifier: KZ61437
2026-03-28 05:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3008db6f-3f31-5528-9f7c-6c162deb58c5 with identifier: KZ61437 to the API
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:26:32Z',
 'fuel_type': 'diesel',
 'id': '3008db6f-3f31-5528-9f7c-6c162deb58c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ61437',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Aircross',
 'odometer': 114429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'Citroen C4 Aircross 1.6 HDi Tendance 2WD',
 'transmission': 'manual',
 'trim': 'Tendance 2WD',
 'year': 2015}
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-28 05:34:57 [auto1.de] INFO: Saving data for KZ61437: {'auction_closing_time': 1774715192.0, 'created_time': 1774552795.143799, 'last_price_update_time': 1774676097.94535}
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ61437') HTTP/1.1" 204 0
2026-03-28 05:34:57 [auto1.de] INFO: Found listing with ID: YC00540
2026-03-28 05:34:57 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-28 05:34:57 [auto1.de] INFO: Scrape type for UD91634: 2
2026-03-28 05:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73f496cb-609d-5a07-b991-c45b37b0b1b9 with identifier: UD91634
2026-03-28 05:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73f496cb-609d-5a07-b991-c45b37b0b1b9 with scrape type 2
2026-03-28 05:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73f496cb-609d-5a07-b991-c45b37b0b1b9 with scrape type 2
2026-03-28 05:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73f496cb-609d-5a07-b991-c45b37b0b1b9, identifier: UD91634
2026-03-28 05:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73f496cb-609d-5a07-b991-c45b37b0b1b9 with identifier: UD91634
2026-03-28 05:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73f496cb-609d-5a07-b991-c45b37b0b1b9 with identifier: UD91634
2026-03-28 05:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73f496cb-609d-5a07-b991-c45b37b0b1b9 with identifier: UD91634 to the API
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:05:20Z',
 'fuel_type': 'hybrid',
 'id': '73f496cb-609d-5a07-b991-c45b37b0b1b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD91634',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 53713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seller_name': None,
 'title': 'Audi Q3 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-28 05:34:58 [auto1.de] INFO: Saving data for UD91634: {'auction_closing_time': 1774713920.0, 'created_time': 1774552123.504869, 'last_price_update_time': 1774676098.401083}
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD91634') HTTP/1.1" 204 0
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: DF24349
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: XC05261
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC05261%27 HTTP/1.1" 200 None
2026-03-28 05:34:58 [auto1.de] INFO: Scrape type for XC05261: 2
2026-03-28 05:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f85e9e1-7649-58c9-8787-90b7e61154c9 with identifier: XC05261
2026-03-28 05:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f85e9e1-7649-58c9-8787-90b7e61154c9 with scrape type 2
2026-03-28 05:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f85e9e1-7649-58c9-8787-90b7e61154c9 with scrape type 2
2026-03-28 05:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f85e9e1-7649-58c9-8787-90b7e61154c9, identifier: XC05261
2026-03-28 05:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f85e9e1-7649-58c9-8787-90b7e61154c9 with identifier: XC05261
2026-03-28 05:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f85e9e1-7649-58c9-8787-90b7e61154c9 with identifier: XC05261
2026-03-28 05:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f85e9e1-7649-58c9-8787-90b7e61154c9 with identifier: XC05261 to the API
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:33:37Z',
 'fuel_type': 'petrol',
 'id': '8f85e9e1-7649-58c9-8787-90b7e61154c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC05261',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 78260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Diamant Edition',
 'transmission': 'manual',
 'trim': 'Diamant Edition',
 'year': 2017}
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC05261%27 HTTP/1.1" 200 None
2026-03-28 05:34:58 [auto1.de] INFO: Saving data for XC05261: {'auction_closing_time': 1774715617.0, 'created_time': 1774551780.873358, 'last_price_update_time': 1774676098.845989}
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC05261') HTTP/1.1" 204 0
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: RG64089
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: AF02191
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-28 05:34:58 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 9199 | hits on page: 40
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: ZD23730
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: LD10656
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: NY16629
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY16629%27 HTTP/1.1" 200 None
2026-03-28 05:34:58 [auto1.de] INFO: Scrape type for NY16629: 0
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: JC12904
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC12904%27 HTTP/1.1" 200 None
2026-03-28 05:34:58 [auto1.de] INFO: Scrape type for JC12904: 0
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: RX38122
2026-03-28 05:34:58 [auto1.de] INFO: Found listing with ID: SX67317
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX67317%27 HTTP/1.1" 200 None
2026-03-28 05:34:59 [auto1.de] INFO: Scrape type for SX67317: 2
2026-03-28 05:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0780afa4-6912-5f36-ad62-0949c0254942 with identifier: SX67317
2026-03-28 05:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0780afa4-6912-5f36-ad62-0949c0254942 with scrape type 2
2026-03-28 05:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0780afa4-6912-5f36-ad62-0949c0254942 with scrape type 2
2026-03-28 05:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0780afa4-6912-5f36-ad62-0949c0254942, identifier: SX67317
2026-03-28 05:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0780afa4-6912-5f36-ad62-0949c0254942 with identifier: SX67317
2026-03-28 05:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0780afa4-6912-5f36-ad62-0949c0254942 with identifier: SX67317
2026-03-28 05:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0780afa4-6912-5f36-ad62-0949c0254942 with identifier: SX67317 to the API
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:11:11Z',
 'fuel_type': 'petrol',
 'id': '0780afa4-6912-5f36-ad62-0949c0254942',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX67317',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 132243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-05',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX67317%27 HTTP/1.1" 200 None
2026-03-28 05:34:59 [auto1.de] INFO: Saving data for SX67317: {'auction_closing_time': 1774714271.0, 'created_time': 1774463630.784932, 'last_price_update_time': 1774676099.478537}
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX67317') HTTP/1.1" 204 0
2026-03-28 05:34:59 [auto1.de] INFO: Found listing with ID: MS04579
2026-03-28 05:34:59 [auto1.de] INFO: Found listing with ID: XM71416
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM71416%27 HTTP/1.1" 200 None
2026-03-28 05:34:59 [auto1.de] INFO: Scrape type for XM71416: 0
2026-03-28 05:34:59 [auto1.de] INFO: Found listing with ID: KR30389
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR30389%27 HTTP/1.1" 200 None
2026-03-28 05:34:59 [auto1.de] INFO: Scrape type for KR30389: 0
2026-03-28 05:34:59 [auto1.de] INFO: Found listing with ID: JX93926
2026-03-28 05:34:59 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-28 05:34:59 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-28 05:34:59 [auto1.de] INFO: Scrape type for AA40394: 0
2026-03-28 05:34:59 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-28 05:34:59 [auto1.de] INFO: Found listing with ID: JL42140
2026-03-28 05:34:59 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-28 05:34:59 [auto1.de] INFO: Scrape type for KL90594: 2
2026-03-28 05:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594
2026-03-28 05:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7387eab6-ccc2-52fe-a102-476781e38c0f with scrape type 2
2026-03-28 05:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7387eab6-ccc2-52fe-a102-476781e38c0f with scrape type 2
2026-03-28 05:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7387eab6-ccc2-52fe-a102-476781e38c0f, identifier: KL90594
2026-03-28 05:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594
2026-03-28 05:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594
2026-03-28 05:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594 to the API
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:49:40Z',
 'fuel_type': 'petrol',
 'id': '7387eab6-ccc2-52fe-a102-476781e38c0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL90594',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Terios',
 'odometer': 156915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-15',
 'seller_name': None,
 'title': 'Daihatsu Terios 1.5 Top 4WD',
 'transmission': 'manual',
 'trim': 'Top 4WD',
 'year': 2009}
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-28 05:34:59 [auto1.de] INFO: Saving data for KL90594: {'auction_closing_time': 1774716580.0, 'created_time': 1774550494.914282, 'last_price_update_time': 1774676099.974762}
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL90594') HTTP/1.1" 204 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: ZR85378
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR85378%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for ZR85378: 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: HY62611
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: JM60205
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM60205%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for JM60205: 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: XC77974
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC77974%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for XC77974: 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: MF87973
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: AE27507
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: KT42001
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT42001%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for KT42001: 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: RX73377
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: RW07911
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for VJ08081: 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: SM08182
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM08182%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for SM08182: 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for PJ27093: 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: WU50689
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU50689%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for WU50689: 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA19754%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for PA19754: 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for SV18867: 2
2026-03-28 05:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867
2026-03-28 05:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with scrape type 2
2026-03-28 05:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with scrape type 2
2026-03-28 05:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56507ea7-c416-5162-aa4e-18dd3b19e8a1, identifier: SV18867
2026-03-28 05:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867
2026-03-28 05:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867
2026-03-28 05:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867 to the API
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:58:06Z',
 'fuel_type': 'diesel',
 'id': '56507ea7-c416-5162-aa4e-18dd3b19e8a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV18867',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 174136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 dCi Energy Crossborder',
 'transmission': 'manual',
 'trim': 'Crossborder',
 'year': 2017}
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Saving data for SV18867: {'auction_closing_time': 1774717086.0, 'created_time': 1774552831.786501, 'last_price_update_time': 1774676100.712438}
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV18867') HTTP/1.1" 204 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: AF68122
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF68122%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for AF68122: 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for SG95649: 0
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-28 05:35:00 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-28 05:35:00 [auto1.de] INFO: Scrape type for DG73044: 2
2026-03-28 05:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044
2026-03-28 05:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f966bfbd-bd95-5299-848b-f2633a8cb12a with scrape type 2
2026-03-28 05:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f966bfbd-bd95-5299-848b-f2633a8cb12a with scrape type 2
2026-03-28 05:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f966bfbd-bd95-5299-848b-f2633a8cb12a, identifier: DG73044
2026-03-28 05:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044
2026-03-28 05:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044
2026-03-28 05:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044 to the API
2026-03-28 05:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:55:26Z',
 'fuel_type': 'petrol',
 'id': 'f966bfbd-bd95-5299-848b-f2633a8cb12a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG73044',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 48162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-09',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-03-28 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-28 05:35:01 [auto1.de] INFO: Saving data for DG73044: {'auction_closing_time': 1774716926.0, 'created_time': 1774552677.139737, 'last_price_update_time': 1774676101.320737}
2026-03-28 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG73044') HTTP/1.1" 204 0
2026-03-28 05:35:01 [auto1.de] INFO: Found listing with ID: UW10679
2026-03-28 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW10679%27 HTTP/1.1" 200 None
2026-03-28 05:35:01 [auto1.de] INFO: Scrape type for UW10679: 0
2026-03-28 05:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:02 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:02 [auto1.de] INFO: Found listing with ID: SC80606
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC80606%27 HTTP/1.1" 200 None
2026-03-28 05:35:02 [auto1.de] INFO: Scrape type for SC80606: 0
2026-03-28 05:35:02 [auto1.de] INFO: Found listing with ID: CC80699
2026-03-28 05:35:02 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-28 05:35:02 [auto1.de] INFO: Scrape type for XV15906: 0
2026-03-28 05:35:02 [auto1.de] INFO: Found listing with ID: ZF80187
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF80187%27 HTTP/1.1" 200 None
2026-03-28 05:35:02 [auto1.de] INFO: Scrape type for ZF80187: 0
2026-03-28 05:35:02 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-28 05:35:02 [auto1.de] INFO: Scrape type for NT47170: 2
2026-03-28 05:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170
2026-03-28 05:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with scrape type 2
2026-03-28 05:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with scrape type 2
2026-03-28 05:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f80e89de-8bc7-51c8-8078-1bb6d162e8b3, identifier: NT47170
2026-03-28 05:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170
2026-03-28 05:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170
2026-03-28 05:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170 to the API
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:52:27Z',
 'fuel_type': 'diesel',
 'id': 'f80e89de-8bc7-51c8-8078-1bb6d162e8b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT47170',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 203812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Conceptline',
 'transmission': 'manual',
 'trim': 'Conceptline',
 'year': 2006}
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-28 05:35:02 [auto1.de] INFO: Saving data for NT47170: {'auction_closing_time': 1774716747.0, 'created_time': 1774550531.079701, 'last_price_update_time': 1774676102.966257}
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT47170') HTTP/1.1" 204 0
2026-03-28 05:35:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: PP91076
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: ZT12374
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT12374%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for ZT12374: 0
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: CS71066
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: SW04854
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: RH18539
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: PD05251
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD05251%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for PD05251: 0
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: DC87160
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: XK64077
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK64077%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for XK64077: 0
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for HD39951: 2
2026-03-28 05:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02b9a86-38cb-539b-a1da-c8ec446dde62 with identifier: HD39951
2026-03-28 05:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02b9a86-38cb-539b-a1da-c8ec446dde62 with scrape type 2
2026-03-28 05:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f02b9a86-38cb-539b-a1da-c8ec446dde62 with scrape type 2
2026-03-28 05:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f02b9a86-38cb-539b-a1da-c8ec446dde62, identifier: HD39951
2026-03-28 05:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f02b9a86-38cb-539b-a1da-c8ec446dde62 with identifier: HD39951
2026-03-28 05:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f02b9a86-38cb-539b-a1da-c8ec446dde62 with identifier: HD39951
2026-03-28 05:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f02b9a86-38cb-539b-a1da-c8ec446dde62 with identifier: HD39951 to the API
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:31:53Z',
 'fuel_type': 'petrol',
 'id': 'f02b9a86-38cb-539b-a1da-c8ec446dde62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD39951',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 108776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Saving data for HD39951: {'auction_closing_time': 1774715513.0, 'created_time': 1774552179.223897, 'last_price_update_time': 1774676103.588938}
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD39951') HTTP/1.1" 204 0
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: WD55827
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: EX30912
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: MP81414
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: TN32839
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: TE76354
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE76354%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for TE76354: 0
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: SB33889
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: EM65900
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM65900%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for EM65900: 0
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: TC03935
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: MG42268
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42268%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for MG42268: 0
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: MP16607
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP16607%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for MP16607: 0
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: JY89366
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: NA04350
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA04350%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for NA04350: 0
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: WP40343
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: LH79634
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH79634%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for LH79634: 0
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: FM58881
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for BW05751: 0
2026-03-28 05:35:03 [auto1.de] INFO: Found listing with ID: HA73784
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA73784%27 HTTP/1.1" 200 None
2026-03-28 05:35:03 [auto1.de] INFO: Scrape type for HA73784: 2
2026-03-28 05:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e26d6c-79b1-571a-a651-647f60d124eb with identifier: HA73784
2026-03-28 05:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e26d6c-79b1-571a-a651-647f60d124eb with scrape type 2
2026-03-28 05:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e26d6c-79b1-571a-a651-647f60d124eb with scrape type 2
2026-03-28 05:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96e26d6c-79b1-571a-a651-647f60d124eb, identifier: HA73784
2026-03-28 05:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96e26d6c-79b1-571a-a651-647f60d124eb with identifier: HA73784
2026-03-28 05:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96e26d6c-79b1-571a-a651-647f60d124eb with identifier: HA73784
2026-03-28 05:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96e26d6c-79b1-571a-a651-647f60d124eb with identifier: HA73784 to the API
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:09Z',
 'fuel_type': 'petrol',
 'id': '96e26d6c-79b1-571a-a651-647f60d124eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA73784',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 19871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-21',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Move',
 'transmission': 'automatic',
 'trim': 'Move',
 'year': 2024}
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA73784%27 HTTP/1.1" 200 None
2026-03-28 05:35:04 [auto1.de] INFO: Saving data for HA73784: {'auction_closing_time': 1774715949.0, 'created_time': 1773946243.087717, 'last_price_update_time': 1774676104.276311}
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA73784') HTTP/1.1" 204 0
2026-03-28 05:35:04 [auto1.de] INFO: Found listing with ID: DZ69774
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ69774%27 HTTP/1.1" 200 None
2026-03-28 05:35:04 [auto1.de] INFO: Scrape type for DZ69774: 0
2026-03-28 05:35:04 [auto1.de] INFO: Found listing with ID: YR73965
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR73965%27 HTTP/1.1" 200 None
2026-03-28 05:35:04 [auto1.de] INFO: Scrape type for YR73965: 0
2026-03-28 05:35:04 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-28 05:35:04 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-28 05:35:04 [auto1.de] INFO: Scrape type for TB77095: 2
2026-03-28 05:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7845e6bb-cfdf-531d-873b-09ec4cefd277 with identifier: TB77095
2026-03-28 05:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7845e6bb-cfdf-531d-873b-09ec4cefd277 with scrape type 2
2026-03-28 05:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7845e6bb-cfdf-531d-873b-09ec4cefd277 with scrape type 2
2026-03-28 05:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7845e6bb-cfdf-531d-873b-09ec4cefd277, identifier: TB77095
2026-03-28 05:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7845e6bb-cfdf-531d-873b-09ec4cefd277 with identifier: TB77095
2026-03-28 05:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7845e6bb-cfdf-531d-873b-09ec4cefd277 with identifier: TB77095
2026-03-28 05:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7845e6bb-cfdf-531d-873b-09ec4cefd277 with identifier: TB77095 to the API
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:10:36Z',
 'fuel_type': 'diesel',
 'id': '7845e6bb-cfdf-531d-873b-09ec4cefd277',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB77095',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 90262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-27',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2017}
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-28 05:35:04 [auto1.de] INFO: Saving data for TB77095: {'auction_closing_time': 1774714236.0, 'created_time': 1773224125.364392, 'last_price_update_time': 1774676104.885261}
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB77095') HTTP/1.1" 204 0
2026-03-28 05:35:04 [auto1.de] INFO: Found listing with ID: JZ59846
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ59846%27 HTTP/1.1" 200 None
2026-03-28 05:35:04 [auto1.de] INFO: Scrape type for JZ59846: 0
2026-03-28 05:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:05 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:05 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-28 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-28 05:35:05 [auto1.de] INFO: Scrape type for DK81331: 2
2026-03-28 05:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b94a30-9c44-5394-9c9b-62a6f7984fed with identifier: DK81331
2026-03-28 05:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b94a30-9c44-5394-9c9b-62a6f7984fed with scrape type 2
2026-03-28 05:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9b94a30-9c44-5394-9c9b-62a6f7984fed with scrape type 2
2026-03-28 05:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9b94a30-9c44-5394-9c9b-62a6f7984fed, identifier: DK81331
2026-03-28 05:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9b94a30-9c44-5394-9c9b-62a6f7984fed with identifier: DK81331
2026-03-28 05:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9b94a30-9c44-5394-9c9b-62a6f7984fed with identifier: DK81331
2026-03-28 05:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9b94a30-9c44-5394-9c9b-62a6f7984fed with identifier: DK81331 to the API
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:08:40Z',
 'fuel_type': 'petrol',
 'id': 'c9b94a30-9c44-5394-9c9b-62a6f7984fed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK81331',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 101580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-28 05:35:06 [auto1.de] INFO: Saving data for DK81331: {'auction_closing_time': 1774714120.0, 'created_time': 1774550288.341359, 'last_price_update_time': 1774676106.303449}
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK81331') HTTP/1.1" 204 0
2026-03-28 05:35:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:06 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-28 05:35:06 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-28 05:35:06 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-28 05:35:06 [auto1.de] INFO: Found listing with ID: JS64304
2026-03-28 05:35:06 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-28 05:35:06 [auto1.de] INFO: Scrape type for WB37074: 2
2026-03-28 05:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3baa359f-fda7-52c2-be4b-625772968c3c with identifier: WB37074
2026-03-28 05:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3baa359f-fda7-52c2-be4b-625772968c3c with scrape type 2
2026-03-28 05:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3baa359f-fda7-52c2-be4b-625772968c3c with scrape type 2
2026-03-28 05:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3baa359f-fda7-52c2-be4b-625772968c3c, identifier: WB37074
2026-03-28 05:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3baa359f-fda7-52c2-be4b-625772968c3c with identifier: WB37074
2026-03-28 05:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3baa359f-fda7-52c2-be4b-625772968c3c with identifier: WB37074
2026-03-28 05:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3baa359f-fda7-52c2-be4b-625772968c3c with identifier: WB37074 to the API
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:06:48Z',
 'fuel_type': 'petrol',
 'id': '3baa359f-fda7-52c2-be4b-625772968c3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB37074',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 55931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion',
 'year': 2020}
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-28 05:35:06 [auto1.de] INFO: Saving data for WB37074: {'auction_closing_time': 1774714008.0, 'created_time': 1774552726.965204, 'last_price_update_time': 1774676106.818919}
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB37074') HTTP/1.1" 204 0
2026-03-28 05:35:06 [auto1.de] INFO: Found listing with ID: ML82340
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML82340%27 HTTP/1.1" 200 None
2026-03-28 05:35:06 [auto1.de] INFO: Scrape type for ML82340: 2
2026-03-28 05:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c08cda77-1eb7-5206-9fb3-79cb38cf7efb with identifier: ML82340
2026-03-28 05:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c08cda77-1eb7-5206-9fb3-79cb38cf7efb with scrape type 2
2026-03-28 05:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c08cda77-1eb7-5206-9fb3-79cb38cf7efb with scrape type 2
2026-03-28 05:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c08cda77-1eb7-5206-9fb3-79cb38cf7efb, identifier: ML82340
2026-03-28 05:35:07 [scrapy.extensions.logstats] INFO: Crawled 100 pages (at 15 pages/min), scraped 340 items (at 72 items/min)
2026-03-28 05:35:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c08cda77-1eb7-5206-9fb3-79cb38cf7efb with identifier: ML82340
2026-03-28 05:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c08cda77-1eb7-5206-9fb3-79cb38cf7efb with identifier: ML82340
2026-03-28 05:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c08cda77-1eb7-5206-9fb3-79cb38cf7efb with identifier: ML82340 to the API
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:33:21Z',
 'fuel_type': 'petrol',
 'id': 'c08cda77-1eb7-5206-9fb3-79cb38cf7efb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML82340',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 120868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-29',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2010}
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML82340%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Saving data for ML82340: {'auction_closing_time': 1774715601.0, 'created_time': 1774463719.006362, 'last_price_update_time': 1774676107.35662}
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML82340') HTTP/1.1" 204 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: HL40021
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL40021%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for HL40021: 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: GT12052
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT12052%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for GT12052: 2
2026-03-28 05:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f62beef-c146-5def-a602-b6c83a92eb0a with identifier: GT12052
2026-03-28 05:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f62beef-c146-5def-a602-b6c83a92eb0a with scrape type 2
2026-03-28 05:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f62beef-c146-5def-a602-b6c83a92eb0a with scrape type 2
2026-03-28 05:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f62beef-c146-5def-a602-b6c83a92eb0a, identifier: GT12052
2026-03-28 05:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f62beef-c146-5def-a602-b6c83a92eb0a with identifier: GT12052
2026-03-28 05:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f62beef-c146-5def-a602-b6c83a92eb0a with identifier: GT12052
2026-03-28 05:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f62beef-c146-5def-a602-b6c83a92eb0a with identifier: GT12052 to the API
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:39:49Z',
 'fuel_type': 'petrol',
 'id': '1f62beef-c146-5def-a602-b6c83a92eb0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT12052',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 164297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-25',
 'seller_name': None,
 'title': 'Audi A6 1.8 TFSI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT12052%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Saving data for GT12052: {'auction_closing_time': 1774715989.0, 'created_time': 1774467027.677023, 'last_price_update_time': 1774676107.785835}
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT12052') HTTP/1.1" 204 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: ZL85266
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL85266%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for ZL85266: 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: XT10731
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT10731%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for XT10731: 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: CW98774
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW98774%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for CW98774: 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: CA15258
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA15258%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for CA15258: 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: ZG64364
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG64364%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for ZG64364: 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for WN92632: 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: NM07920
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM07920%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for NM07920: 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: BP47263
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: HS50383
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: BV07882
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV07882%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for BV07882: 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for UB19206: 0
2026-03-28 05:35:07 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-28 05:35:07 [auto1.de] INFO: Scrape type for TG50792: 2
2026-03-28 05:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d6c292c-6205-5bfc-aa84-28b431239000 with identifier: TG50792
2026-03-28 05:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d6c292c-6205-5bfc-aa84-28b431239000 with scrape type 2
2026-03-28 05:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d6c292c-6205-5bfc-aa84-28b431239000 with scrape type 2
2026-03-28 05:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d6c292c-6205-5bfc-aa84-28b431239000, identifier: TG50792
2026-03-28 05:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d6c292c-6205-5bfc-aa84-28b431239000 with identifier: TG50792
2026-03-28 05:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d6c292c-6205-5bfc-aa84-28b431239000 with identifier: TG50792
2026-03-28 05:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d6c292c-6205-5bfc-aa84-28b431239000 with identifier: TG50792 to the API
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:02:17Z',
 'fuel_type': 'diesel',
 'id': '2d6c292c-6205-5bfc-aa84-28b431239000',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG50792',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 86833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-16',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L5H2 RS: 4035 mm',
 'transmission': 'manual',
 'trim': 'L5H2 RS: 4035 mm',
 'year': 2022}
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-28 05:35:08 [auto1.de] INFO: Saving data for TG50792: {'auction_closing_time': 1774713737.0, 'created_time': 1774552889.239327, 'last_price_update_time': 1774676108.356041}
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG50792') HTTP/1.1" 204 0
2026-03-28 05:35:08 [auto1.de] INFO: Found listing with ID: NB15408
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB15408%27 HTTP/1.1" 200 None
2026-03-28 05:35:08 [auto1.de] INFO: Scrape type for NB15408: 0
2026-03-28 05:35:08 [auto1.de] INFO: Found listing with ID: HC41617
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC41617%27 HTTP/1.1" 200 None
2026-03-28 05:35:08 [auto1.de] INFO: Scrape type for HC41617: 0
2026-03-28 05:35:08 [auto1.de] INFO: Found listing with ID: YE23414
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE23414%27 HTTP/1.1" 200 None
2026-03-28 05:35:08 [auto1.de] INFO: Scrape type for YE23414: 0
2026-03-28 05:35:08 [auto1.de] INFO: Found listing with ID: ZT65198
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT65198%27 HTTP/1.1" 200 None
2026-03-28 05:35:08 [auto1.de] INFO: Scrape type for ZT65198: 0
2026-03-28 05:35:08 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY46967%27 HTTP/1.1" 200 None
2026-03-28 05:35:08 [auto1.de] INFO: Scrape type for FY46967: 0
2026-03-28 05:35:08 [auto1.de] INFO: Found listing with ID: GL26328
2026-03-28 05:35:08 [auto1.de] INFO: Found listing with ID: DU86117
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU86117%27 HTTP/1.1" 200 None
2026-03-28 05:35:08 [auto1.de] INFO: Scrape type for DU86117: 0
2026-03-28 05:35:08 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-28 05:35:08 [auto1.de] INFO: Scrape type for TH75068: 2
2026-03-28 05:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068
2026-03-28 05:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ba38eb-0bd3-55c4-8f67-b4be6553898f with scrape type 2
2026-03-28 05:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60ba38eb-0bd3-55c4-8f67-b4be6553898f with scrape type 2
2026-03-28 05:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60ba38eb-0bd3-55c4-8f67-b4be6553898f, identifier: TH75068
2026-03-28 05:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068
2026-03-28 05:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068
2026-03-28 05:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068 to the API
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:55:46Z',
 'fuel_type': 'diesel',
 'id': '60ba38eb-0bd3-55c4-8f67-b4be6553898f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH75068',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 213073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-29',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Saving data for TH75068: {'auction_closing_time': 1774716946.0, 'created_time': 1774552169.193334, 'last_price_update_time': 1774676109.000014}
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH75068') HTTP/1.1" 204 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for GC11605: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: NY45531
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45531%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for NY45531: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: LL46180
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: FF33829
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: LC24669
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC24669%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for LC24669: 0
2026-03-28 05:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:09 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: LY01980
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY01980%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for LY01980: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: TP41556
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP41556%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for TP41556: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: GG09705
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG09705%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for GG09705: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: TW00393
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: BK38735
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: TH33343
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH33343%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for TH33343: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ16531%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for AJ16531: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95510%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for FK95510: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for YU70640: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: MY07793
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY07793%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for MY07793: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: JM29526
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for AE64290: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: SS89837
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89837%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for SS89837: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: WS21373
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS21373%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for WS21373: 0
2026-03-28 05:35:09 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-28 05:35:09 [auto1.de] INFO: Scrape type for UV26569: 2
2026-03-28 05:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569
2026-03-28 05:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52870aa1-64fe-55f8-bcb2-c41fec631421 with scrape type 2
2026-03-28 05:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52870aa1-64fe-55f8-bcb2-c41fec631421 with scrape type 2
2026-03-28 05:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52870aa1-64fe-55f8-bcb2-c41fec631421, identifier: UV26569
2026-03-28 05:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569
2026-03-28 05:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569
2026-03-28 05:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569 to the API
2026-03-28 05:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:55:57Z',
 'fuel_type': 'petrol',
 'id': '52870aa1-64fe-55f8-bcb2-c41fec631421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV26569',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 91359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-24',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2009}
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-28 05:35:10 [auto1.de] INFO: Saving data for UV26569: {'auction_closing_time': 1774716957.0, 'created_time': 1774552993.575805, 'last_price_update_time': 1774676110.143018}
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV26569') HTTP/1.1" 204 0
2026-03-28 05:35:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: UU82281
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU82281%27 HTTP/1.1" 200 None
2026-03-28 05:35:10 [auto1.de] INFO: Scrape type for UU82281: 0
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: VZ69122
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-28 05:35:10 [auto1.de] INFO: Scrape type for XK50877: 2
2026-03-28 05:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with identifier: XK50877
2026-03-28 05:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with scrape type 2
2026-03-28 05:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with scrape type 2
2026-03-28 05:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20ea2a3e-64db-5f90-82fe-aa3178eb4a85, identifier: XK50877
2026-03-28 05:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with identifier: XK50877
2026-03-28 05:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with identifier: XK50877
2026-03-28 05:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with identifier: XK50877 to the API
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-28T16:12:41Z',
 'fuel_type': 'petrol',
 'id': '20ea2a3e-64db-5f90-82fe-aa3178eb4a85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK50877',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 76862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-30',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 290',
 'transmission': 'automatic',
 'trim': 'Cupra 290',
 'year': 2019}
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-28 05:35:10 [auto1.de] INFO: Saving data for XK50877: {'auction_closing_time': 1774714361.0, 'created_time': 1773945871.386987, 'last_price_update_time': 1774676110.682792}
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK50877') HTTP/1.1" 204 0
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: MU43821
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: YF97500
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: RU37876
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU37876%27 HTTP/1.1" 200 None
2026-03-28 05:35:10 [auto1.de] INFO: Scrape type for RU37876: 0
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: PG24106
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24106%27 HTTP/1.1" 200 None
2026-03-28 05:35:10 [auto1.de] INFO: Scrape type for PG24106: 0
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: JL53088
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-28 05:35:10 [auto1.de] INFO: Scrape type for MX86281: 0
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-28 05:35:10 [auto1.de] INFO: Scrape type for KE90255: 0
2026-03-28 05:35:10 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-28 05:35:10 [auto1.de] INFO: Scrape type for UA17642: 2
2026-03-28 05:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 281c48a2-9001-5867-bc78-232153fdb6a3 with identifier: UA17642
2026-03-28 05:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 281c48a2-9001-5867-bc78-232153fdb6a3 with scrape type 2
2026-03-28 05:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 281c48a2-9001-5867-bc78-232153fdb6a3 with scrape type 2
2026-03-28 05:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 281c48a2-9001-5867-bc78-232153fdb6a3, identifier: UA17642
2026-03-28 05:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 281c48a2-9001-5867-bc78-232153fdb6a3 with identifier: UA17642
2026-03-28 05:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 281c48a2-9001-5867-bc78-232153fdb6a3 with identifier: UA17642
2026-03-28 05:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 281c48a2-9001-5867-bc78-232153fdb6a3 with identifier: UA17642 to the API
2026-03-28 05:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:31Z',
 'fuel_type': 'petrol',
 'id': '281c48a2-9001-5867-bc78-232153fdb6a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA17642',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 45161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-17',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-28 05:35:11 [auto1.de] INFO: Saving data for UA17642: {'auction_closing_time': 1774714171.0, 'created_time': 1774552947.821317, 'last_price_update_time': 1774676111.198709}
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA17642') HTTP/1.1" 204 0
2026-03-28 05:35:11 [auto1.de] INFO: Found listing with ID: RD87783
2026-03-28 05:35:11 [auto1.de] INFO: Found listing with ID: BV34042
2026-03-28 05:35:11 [auto1.de] INFO: Found listing with ID: AP11154
2026-03-28 05:35:11 [auto1.de] INFO: Found listing with ID: CZ93275
2026-03-28 05:35:11 [auto1.de] INFO: Found listing with ID: MT27523
2026-03-28 05:35:11 [auto1.de] INFO: Found listing with ID: PX90608
2026-03-28 05:35:11 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-28 05:35:11 [auto1.de] INFO: Scrape type for RM28655: 2
2026-03-28 05:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655
2026-03-28 05:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c54a8567-4edc-5867-bbbe-2b9e136ad539 with scrape type 2
2026-03-28 05:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c54a8567-4edc-5867-bbbe-2b9e136ad539 with scrape type 2
2026-03-28 05:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c54a8567-4edc-5867-bbbe-2b9e136ad539, identifier: RM28655
2026-03-28 05:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655
2026-03-28 05:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655
2026-03-28 05:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655 to the API
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:56:54Z',
 'fuel_type': 'petrol',
 'id': 'c54a8567-4edc-5867-bbbe-2b9e136ad539',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM28655',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 62430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Mazda MX-5 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-28 05:35:11 [auto1.de] INFO: Saving data for RM28655: {'auction_closing_time': 1774717014.0, 'created_time': 1774552530.58863, 'last_price_update_time': 1774676111.74802}
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM28655') HTTP/1.1" 204 0
2026-03-28 05:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:13 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: KG59936
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG59936%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for KG59936: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for CS78773: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: SN35212
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN35212%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for SN35212: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: HU03787
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU03787%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for HU03787: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: VU91072
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU91072%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for VU91072: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for DP30062: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: MN64369
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN64369%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for MN64369: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: ED76181
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED76181%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for ED76181: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for RF79085: 2
2026-03-28 05:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085
2026-03-28 05:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff71619-8f0b-5390-9647-6cc527d31ac0 with scrape type 2
2026-03-28 05:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ff71619-8f0b-5390-9647-6cc527d31ac0 with scrape type 2
2026-03-28 05:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ff71619-8f0b-5390-9647-6cc527d31ac0, identifier: RF79085
2026-03-28 05:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085
2026-03-28 05:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085
2026-03-28 05:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085 to the API
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:49:58Z',
 'fuel_type': 'diesel',
 'id': '1ff71619-8f0b-5390-9647-6cc527d31ac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF79085',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 120057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-24',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi BOSE-Edition',
 'transmission': 'manual',
 'trim': 'BOSE-Edition',
 'year': 2020}
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Saving data for RF79085: {'auction_closing_time': 1774716598.0, 'created_time': 1773946273.632111, 'last_price_update_time': 1774676113.654371}
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF79085') HTTP/1.1" 204 0
2026-03-28 05:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: RN08070
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for WC28645: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: RV28657
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: KW34435
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW34435%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for KW34435: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: RK34860
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: GF47308
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: JB31232
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: LU32216
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU32216%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for LU32216: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: WX65526
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: TG18023
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG18023%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for TG18023: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: FN23082
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: PP57494
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP57494%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for PP57494: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: NU57672
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU57672%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for NU57672: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: NX98463
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98463%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for NX98463: 0
2026-03-28 05:35:13 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-28 05:35:13 [auto1.de] INFO: Scrape type for BW69940: 2
2026-03-28 05:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b702739f-96a4-58f0-87c3-ed9c40e18978 with identifier: BW69940
2026-03-28 05:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b702739f-96a4-58f0-87c3-ed9c40e18978 with scrape type 2
2026-03-28 05:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b702739f-96a4-58f0-87c3-ed9c40e18978 with scrape type 2
2026-03-28 05:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b702739f-96a4-58f0-87c3-ed9c40e18978, identifier: BW69940
2026-03-28 05:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b702739f-96a4-58f0-87c3-ed9c40e18978 with identifier: BW69940
2026-03-28 05:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b702739f-96a4-58f0-87c3-ed9c40e18978 with identifier: BW69940
2026-03-28 05:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b702739f-96a4-58f0-87c3-ed9c40e18978 with identifier: BW69940 to the API
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:22:11Z',
 'fuel_type': 'diesel',
 'id': 'b702739f-96a4-58f0-87c3-ed9c40e18978',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW69940',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 129836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-25',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2024}
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-28 05:35:14 [auto1.de] INFO: Saving data for BW69940: {'auction_closing_time': 1774714931.0, 'created_time': 1774467396.528103, 'last_price_update_time': 1774676114.315118}
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW69940') HTTP/1.1" 204 0
2026-03-28 05:35:14 [auto1.de] INFO: Found listing with ID: BH79353
2026-03-28 05:35:14 [auto1.de] INFO: Found listing with ID: EV47698
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV47698%27 HTTP/1.1" 200 None
2026-03-28 05:35:14 [auto1.de] INFO: Scrape type for EV47698: 0
2026-03-28 05:35:14 [auto1.de] INFO: Found listing with ID: LR04011
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR04011%27 HTTP/1.1" 200 None
2026-03-28 05:35:14 [auto1.de] INFO: Scrape type for LR04011: 0
2026-03-28 05:35:14 [auto1.de] INFO: Found listing with ID: CK66212
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK66212%27 HTTP/1.1" 200 None
2026-03-28 05:35:14 [auto1.de] INFO: Scrape type for CK66212: 0
2026-03-28 05:35:14 [auto1.de] INFO: Found listing with ID: LS52090
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS52090%27 HTTP/1.1" 200 None
2026-03-28 05:35:14 [auto1.de] INFO: Scrape type for LS52090: 0
2026-03-28 05:35:14 [auto1.de] INFO: Found listing with ID: ZT39805
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT39805%27 HTTP/1.1" 200 None
2026-03-28 05:35:14 [auto1.de] INFO: Scrape type for ZT39805: 0
2026-03-28 05:35:14 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-28 05:35:14 [auto1.de] INFO: Scrape type for RR35143: 0
2026-03-28 05:35:14 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-28 05:35:14 [auto1.de] INFO: Scrape type for XF59932: 0
2026-03-28 05:35:14 [auto1.de] INFO: Found listing with ID: ZG00805
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00805%27 HTTP/1.1" 200 None
2026-03-28 05:35:14 [auto1.de] INFO: Scrape type for ZG00805: 2
2026-03-28 05:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc7bb51-15e0-5d5f-8817-e80aec306eab with identifier: ZG00805
2026-03-28 05:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc7bb51-15e0-5d5f-8817-e80aec306eab with scrape type 2
2026-03-28 05:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bc7bb51-15e0-5d5f-8817-e80aec306eab with scrape type 2
2026-03-28 05:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bc7bb51-15e0-5d5f-8817-e80aec306eab, identifier: ZG00805
2026-03-28 05:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bc7bb51-15e0-5d5f-8817-e80aec306eab with identifier: ZG00805
2026-03-28 05:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bc7bb51-15e0-5d5f-8817-e80aec306eab with identifier: ZG00805
2026-03-28 05:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bc7bb51-15e0-5d5f-8817-e80aec306eab with identifier: ZG00805 to the API
2026-03-28 05:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:27:45Z',
 'fuel_type': 'diesel',
 'id': '7bc7bb51-15e0-5d5f-8817-e80aec306eab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG00805',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 44782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-06',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L1H1 RS: 3000 mm',
 'transmission': 'manual',
 'trim': 'L1H1 RS: 3000 mm',
 'year': 2023}
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00805%27 HTTP/1.1" 200 None
2026-03-28 05:35:15 [auto1.de] INFO: Saving data for ZG00805: {'auction_closing_time': 1774715265.0, 'created_time': 1774552677.632669, 'last_price_update_time': 1774676115.794534}
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG00805') HTTP/1.1" 204 0
2026-03-28 05:35:15 [auto1.de] INFO: Found listing with ID: BN46018
2026-03-28 05:35:15 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-28 05:35:15 [auto1.de] INFO: Found listing with ID: EB21377
2026-03-28 05:35:15 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-28 05:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:16 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:16 [auto1.de] INFO: Found listing with ID: MW19833
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW19833%27 HTTP/1.1" 200 None
2026-03-28 05:35:16 [auto1.de] INFO: Scrape type for MW19833: 0
2026-03-28 05:35:16 [auto1.de] INFO: Found listing with ID: XR23222
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR23222%27 HTTP/1.1" 200 None
2026-03-28 05:35:16 [auto1.de] INFO: Scrape type for XR23222: 0
2026-03-28 05:35:16 [auto1.de] INFO: Found listing with ID: AW57612
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW57612%27 HTTP/1.1" 200 None
2026-03-28 05:35:16 [auto1.de] INFO: Scrape type for AW57612: 0
2026-03-28 05:35:16 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-28 05:35:16 [auto1.de] INFO: Scrape type for UE61705: 0
2026-03-28 05:35:16 [auto1.de] INFO: Found listing with ID: VV06990
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV06990%27 HTTP/1.1" 200 None
2026-03-28 05:35:16 [auto1.de] INFO: Scrape type for VV06990: 2
2026-03-28 05:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de49643c-7a0f-5d4b-ac78-3071682deb4a with identifier: VV06990
2026-03-28 05:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de49643c-7a0f-5d4b-ac78-3071682deb4a with scrape type 2
2026-03-28 05:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de49643c-7a0f-5d4b-ac78-3071682deb4a with scrape type 2
2026-03-28 05:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de49643c-7a0f-5d4b-ac78-3071682deb4a, identifier: VV06990
2026-03-28 05:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de49643c-7a0f-5d4b-ac78-3071682deb4a with identifier: VV06990
2026-03-28 05:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de49643c-7a0f-5d4b-ac78-3071682deb4a with identifier: VV06990
2026-03-28 05:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de49643c-7a0f-5d4b-ac78-3071682deb4a with identifier: VV06990 to the API
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:23:37Z',
 'fuel_type': 'diesel',
 'id': 'de49643c-7a0f-5d4b-ac78-3071682deb4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV06990',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 192711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-09',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV06990%27 HTTP/1.1" 200 None
2026-03-28 05:35:17 [auto1.de] INFO: Saving data for VV06990: {'auction_closing_time': 1774715017.0, 'created_time': 1774589462.027187, 'last_price_update_time': 1774676117.845702}
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV06990') HTTP/1.1" 204 0
2026-03-28 05:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: PV23969
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV23969%27 HTTP/1.1" 200 None
2026-03-28 05:35:17 [auto1.de] INFO: Scrape type for PV23969: 0
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: VP95925
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: EJ11431
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: YF17855
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF17855%27 HTTP/1.1" 200 None
2026-03-28 05:35:17 [auto1.de] INFO: Scrape type for YF17855: 0
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: FX38179
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX38179%27 HTTP/1.1" 200 None
2026-03-28 05:35:17 [auto1.de] INFO: Scrape type for FX38179: 0
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: HV72401
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: KZ72468
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ72468%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for KZ72468: 0
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: GN02679
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN02679%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for GN02679: 2
2026-03-28 05:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9313ac2-ad50-515a-8b00-a94055f45f02 with identifier: GN02679
2026-03-28 05:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9313ac2-ad50-515a-8b00-a94055f45f02 with scrape type 2
2026-03-28 05:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9313ac2-ad50-515a-8b00-a94055f45f02 with scrape type 2
2026-03-28 05:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9313ac2-ad50-515a-8b00-a94055f45f02, identifier: GN02679
2026-03-28 05:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9313ac2-ad50-515a-8b00-a94055f45f02 with identifier: GN02679
2026-03-28 05:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9313ac2-ad50-515a-8b00-a94055f45f02 with identifier: GN02679
2026-03-28 05:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9313ac2-ad50-515a-8b00-a94055f45f02 with identifier: GN02679 to the API
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:12:21Z',
 'fuel_type': 'diesel',
 'id': 'e9313ac2-ad50-515a-8b00-a94055f45f02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN02679',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 196786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-14',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Kasten Trendline',
 'transmission': 'manual',
 'trim': 'Maxi Kasten Trendline',
 'year': 2015}
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN02679%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Saving data for GN02679: {'auction_closing_time': 1774714341.0, 'created_time': 1774466404.67626, 'last_price_update_time': 1774676118.466223}
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN02679') HTTP/1.1" 204 0
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: MW52698
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW52698%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for MW52698: 0
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for XK62781: 0
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: EX50371
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX50371%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for EX50371: 0
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: SM53889
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM53889%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for SM53889: 0
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: ZJ15384
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: EJ51089
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: RH43725
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: HL37424
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL37424%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for HL37424: 0
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for AU06034: 2
2026-03-28 05:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034
2026-03-28 05:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ce9e7a-d909-5e79-836f-98ded9635476 with scrape type 2
2026-03-28 05:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0ce9e7a-d909-5e79-836f-98ded9635476 with scrape type 2
2026-03-28 05:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0ce9e7a-d909-5e79-836f-98ded9635476, identifier: AU06034
2026-03-28 05:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034
2026-03-28 05:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034
2026-03-28 05:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034 to the API
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:36:40Z',
 'fuel_type': 'diesel',
 'id': 'e0ce9e7a-d909-5e79-836f-98ded9635476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU06034',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 49012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-17',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-28 05:35:19 [auto1.de] INFO: Saving data for AU06034: {'auction_closing_time': 1774715800.0, 'created_time': 1774550400.677971, 'last_price_update_time': 1774676119.011745}
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU06034') HTTP/1.1" 204 0
2026-03-28 05:35:19 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77403%27 HTTP/1.1" 200 None
2026-03-28 05:35:19 [auto1.de] INFO: Scrape type for WS77403: 0
2026-03-28 05:35:19 [auto1.de] INFO: Found listing with ID: TK41211
2026-03-28 05:35:19 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-28 05:35:19 [auto1.de] INFO: Found listing with ID: WC75235
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC75235%27 HTTP/1.1" 200 None
2026-03-28 05:35:19 [auto1.de] INFO: Scrape type for WC75235: 0
2026-03-28 05:35:19 [auto1.de] INFO: Found listing with ID: DA54133
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA54133%27 HTTP/1.1" 200 None
2026-03-28 05:35:19 [auto1.de] INFO: Scrape type for DA54133: 2
2026-03-28 05:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e555b013-dc2c-589e-ac46-eb64a46ff4c3 with identifier: DA54133
2026-03-28 05:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e555b013-dc2c-589e-ac46-eb64a46ff4c3 with scrape type 2
2026-03-28 05:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e555b013-dc2c-589e-ac46-eb64a46ff4c3 with scrape type 2
2026-03-28 05:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e555b013-dc2c-589e-ac46-eb64a46ff4c3, identifier: DA54133
2026-03-28 05:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e555b013-dc2c-589e-ac46-eb64a46ff4c3 with identifier: DA54133
2026-03-28 05:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e555b013-dc2c-589e-ac46-eb64a46ff4c3 with identifier: DA54133
2026-03-28 05:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e555b013-dc2c-589e-ac46-eb64a46ff4c3 with identifier: DA54133 to the API
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:15:54Z',
 'fuel_type': 'petrol',
 'id': 'e555b013-dc2c-589e-ac46-eb64a46ff4c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA54133',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 98551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA54133%27 HTTP/1.1" 200 None
2026-03-28 05:35:19 [auto1.de] INFO: Saving data for DA54133: {'auction_closing_time': 1774714554.0, 'created_time': 1773229511.761201, 'last_price_update_time': 1774676119.877766}
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA54133') HTTP/1.1" 204 0
2026-03-28 05:35:19 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-28 05:35:19 [auto1.de] INFO: Scrape type for KX50860: 2
2026-03-28 05:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860
2026-03-28 05:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with scrape type 2
2026-03-28 05:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with scrape type 2
2026-03-28 05:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd, identifier: KX50860
2026-03-28 05:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860
2026-03-28 05:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860
2026-03-28 05:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860 to the API
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:49:59Z',
 'fuel_type': 'diesel',
 'id': 'f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX50860',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 229208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-28',
 'seller_name': None,
 'title': 'Ford Mondeo 2.2 TDCi Titanium S',
 'transmission': 'manual',
 'trim': 'Titanium S',
 'year': 2012}
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-28 05:35:20 [auto1.de] INFO: Saving data for KX50860: {'auction_closing_time': 1774716599.0, 'created_time': 1774552609.02483, 'last_price_update_time': 1774676120.365524}
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX50860') HTTP/1.1" 204 0
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-28 05:35:20 [auto1.de] INFO: Scrape type for YF68653: 0
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: EH94118
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: PV02416
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: RG17194
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG17194%27 HTTP/1.1" 200 None
2026-03-28 05:35:20 [auto1.de] INFO: Scrape type for RG17194: 0
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: UV04779
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04779%27 HTTP/1.1" 200 None
2026-03-28 05:35:20 [auto1.de] INFO: Scrape type for UV04779: 0
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-28 05:35:20 [auto1.de] INFO: Scrape type for XR73410: 0
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07849%27 HTTP/1.1" 200 None
2026-03-28 05:35:20 [auto1.de] INFO: Scrape type for ZL07849: 0
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: WD56073
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD56073%27 HTTP/1.1" 200 None
2026-03-28 05:35:20 [auto1.de] INFO: Scrape type for WD56073: 0
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: MS74297
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-28 05:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:21 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: YM05661
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-28 05:35:21 [auto1.de] INFO: Scrape type for YD12579: 2
2026-03-28 05:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579
2026-03-28 05:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with scrape type 2
2026-03-28 05:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with scrape type 2
2026-03-28 05:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26, identifier: YD12579
2026-03-28 05:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579
2026-03-28 05:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579
2026-03-28 05:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579 to the API
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:59:40Z',
 'fuel_type': 'petrol',
 'id': '2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD12579',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 64302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-18',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 Comfort AWD',
 'transmission': 'automatic',
 'trim': 'Comfort AWD',
 'year': 2011}
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-28 05:35:21 [auto1.de] INFO: Saving data for YD12579: {'auction_closing_time': 1774717180.0, 'created_time': 1774551513.529619, 'last_price_update_time': 1774676121.817965}
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD12579') HTTP/1.1" 204 0
2026-03-28 05:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: HK56220
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK56220%27 HTTP/1.1" 200 None
2026-03-28 05:35:21 [auto1.de] INFO: Scrape type for HK56220: 0
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: XE60710
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: NC17523
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: UY88235
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: XL96433
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL96433%27 HTTP/1.1" 200 None
2026-03-28 05:35:21 [auto1.de] INFO: Scrape type for XL96433: 0
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-28 05:35:21 [auto1.de] INFO: Scrape type for ZN01973: 0
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: NC53350
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC53350%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Scrape type for NC53350: 0
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Scrape type for EJ12041: 2
2026-03-28 05:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with identifier: EJ12041
2026-03-28 05:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with scrape type 2
2026-03-28 05:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with scrape type 2
2026-03-28 05:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2f9d3ce-86ed-5e95-b10d-cc1579e8142c, identifier: EJ12041
2026-03-28 05:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with identifier: EJ12041
2026-03-28 05:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with identifier: EJ12041
2026-03-28 05:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with identifier: EJ12041 to the API
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:12:05Z',
 'fuel_type': 'petrol',
 'id': 'c2f9d3ce-86ed-5e95-b10d-cc1579e8142c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ12041',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 22243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-02',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2024}
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Saving data for EJ12041: {'auction_closing_time': 1774714325.0, 'created_time': 1774552764.733147, 'last_price_update_time': 1774676122.459437}
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ12041') HTTP/1.1" 204 0
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: AN47371
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: CP02009
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP02009%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Scrape type for CP02009: 0
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Scrape type for BS00370: 0
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: KL64193
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: SC06159
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL55365%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Scrape type for GL55365: 2
2026-03-28 05:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365
2026-03-28 05:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f813d7c8-36cf-5bc5-8929-a768a199bb5a with scrape type 2
2026-03-28 05:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f813d7c8-36cf-5bc5-8929-a768a199bb5a with scrape type 2
2026-03-28 05:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f813d7c8-36cf-5bc5-8929-a768a199bb5a, identifier: GL55365
2026-03-28 05:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365
2026-03-28 05:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365
2026-03-28 05:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365 to the API
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:28:14Z',
 'fuel_type': 'petrol',
 'id': 'f813d7c8-36cf-5bc5-8929-a768a199bb5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL55365',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'IS-Serie',
 'odometer': 160757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-05-30',
 'seller_name': None,
 'title': 'Lexus IS-Serie IS 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL55365%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Saving data for GL55365: {'auction_closing_time': 1774715294.0, 'created_time': 1773132564.471648, 'last_price_update_time': 1774676122.930735}
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL55365') HTTP/1.1" 204 0
2026-03-28 05:35:23 [auto1.de] INFO: Found listing with ID: BH13413
2026-03-28 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH13413%27 HTTP/1.1" 200 None
2026-03-28 05:35:23 [auto1.de] INFO: Scrape type for BH13413: 2
2026-03-28 05:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7bc135c-cdfb-56fc-bdeb-81c3727633f1 with identifier: BH13413
2026-03-28 05:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7bc135c-cdfb-56fc-bdeb-81c3727633f1 with scrape type 2
2026-03-28 05:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7bc135c-cdfb-56fc-bdeb-81c3727633f1 with scrape type 2
2026-03-28 05:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7bc135c-cdfb-56fc-bdeb-81c3727633f1, identifier: BH13413
2026-03-28 05:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7bc135c-cdfb-56fc-bdeb-81c3727633f1 with identifier: BH13413
2026-03-28 05:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7bc135c-cdfb-56fc-bdeb-81c3727633f1 with identifier: BH13413
2026-03-28 05:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7bc135c-cdfb-56fc-bdeb-81c3727633f1 with identifier: BH13413 to the API
2026-03-28 05:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:55:49Z',
 'fuel_type': 'petrol',
 'id': 'b7bc135c-cdfb-56fc-bdeb-81c3727633f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH13413',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 421614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-12',
 'seller_name': None,
 'title': 'Renault Laguna 2.0 Turbo GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2006}
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH13413%27 HTTP/1.1" 200 None
2026-03-28 05:35:24 [auto1.de] INFO: Saving data for BH13413: {'auction_closing_time': 1774716949.0, 'created_time': 1773303055.04596, 'last_price_update_time': 1774676124.335212}
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH13413') HTTP/1.1" 204 0
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: FP74638
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT42792%27 HTTP/1.1" 200 None
2026-03-28 05:35:24 [auto1.de] INFO: Scrape type for VT42792: 0
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: HY48738
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: ZH02957
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH02957%27 HTTP/1.1" 200 None
2026-03-28 05:35:24 [auto1.de] INFO: Scrape type for ZH02957: 2
2026-03-28 05:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b340a278-bc07-5642-a54d-2e8068558cb1 with identifier: ZH02957
2026-03-28 05:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b340a278-bc07-5642-a54d-2e8068558cb1 with scrape type 2
2026-03-28 05:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b340a278-bc07-5642-a54d-2e8068558cb1 with scrape type 2
2026-03-28 05:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b340a278-bc07-5642-a54d-2e8068558cb1, identifier: ZH02957
2026-03-28 05:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b340a278-bc07-5642-a54d-2e8068558cb1 with identifier: ZH02957
2026-03-28 05:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b340a278-bc07-5642-a54d-2e8068558cb1 with identifier: ZH02957
2026-03-28 05:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b340a278-bc07-5642-a54d-2e8068558cb1 with identifier: ZH02957 to the API
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:34:05Z',
 'fuel_type': 'diesel',
 'id': 'b340a278-bc07-5642-a54d-2e8068558cb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH02957',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 150312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-29',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2015}
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH02957%27 HTTP/1.1" 200 None
2026-03-28 05:35:24 [auto1.de] INFO: Saving data for ZH02957: {'auction_closing_time': 1774715645.0, 'created_time': 1774466423.772856, 'last_price_update_time': 1774676124.786432}
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH02957') HTTP/1.1" 204 0
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-28 05:35:24 [auto1.de] INFO: Scrape type for GT84792: 0
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP40831%27 HTTP/1.1" 200 None
2026-03-28 05:35:24 [auto1.de] INFO: Scrape type for UP40831: 0
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: DS39411
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS39411%27 HTTP/1.1" 200 None
2026-03-28 05:35:24 [auto1.de] INFO: Scrape type for DS39411: 0
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: VS91117
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS91117%27 HTTP/1.1" 200 None
2026-03-28 05:35:24 [auto1.de] INFO: Scrape type for VS91117: 0
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: CR26579
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-28 05:35:24 [auto1.de] INFO: Scrape type for JE51939: 2
2026-03-28 05:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939
2026-03-28 05:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 648b4ca1-e5c9-55db-893e-80ab38c67e99 with scrape type 2
2026-03-28 05:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 648b4ca1-e5c9-55db-893e-80ab38c67e99 with scrape type 2
2026-03-28 05:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 648b4ca1-e5c9-55db-893e-80ab38c67e99, identifier: JE51939
2026-03-28 05:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939
2026-03-28 05:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939
2026-03-28 05:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939 to the API
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:59:10Z',
 'fuel_type': 'hybrid',
 'id': '648b4ca1-e5c9-55db-893e-80ab38c67e99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE51939',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 30566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-23',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2022}
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-28 05:35:25 [auto1.de] INFO: Saving data for JE51939: {'auction_closing_time': 1774717150.0, 'created_time': 1774550888.486793, 'last_price_update_time': 1774676125.897467}
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE51939') HTTP/1.1" 204 0
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [auto1.de] INFO: Scrape type for ZP65093: 2
2026-03-28 05:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093
2026-03-28 05:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a02073-424e-5eb9-bbb7-bb8bd0142eba with scrape type 2
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a02073-424e-5eb9-bbb7-bb8bd0142eba with scrape type 2
2026-03-28 05:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40a02073-424e-5eb9-bbb7-bb8bd0142eba, identifier: ZP65093
2026-03-28 05:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093
2026-03-28 05:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093
2026-03-28 05:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093 to the API
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:44Z',
 'fuel_type': 'petrol',
 'id': '40a02073-424e-5eb9-bbb7-bb8bd0142eba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP65093',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 156109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-25',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2013}
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [auto1.de] INFO: Saving data for ZP65093: {'auction_closing_time': 1774716824.0, 'created_time': 1773227525.60467, 'last_price_update_time': 1774676126.445082}
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP65093') HTTP/1.1" 204 0
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: TD14056
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD14056%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [auto1.de] INFO: Scrape type for TD14056: 0
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: RR62010
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR62010%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [auto1.de] INFO: Scrape type for RR62010: 0
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: HS70377
2026-03-28 05:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:27 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for HU97464: 2
2026-03-28 05:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ccc47a3-c757-51e7-ad75-633138d47c0a with identifier: HU97464
2026-03-28 05:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ccc47a3-c757-51e7-ad75-633138d47c0a with scrape type 2
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ccc47a3-c757-51e7-ad75-633138d47c0a with scrape type 2
2026-03-28 05:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ccc47a3-c757-51e7-ad75-633138d47c0a, identifier: HU97464
2026-03-28 05:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ccc47a3-c757-51e7-ad75-633138d47c0a with identifier: HU97464
2026-03-28 05:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ccc47a3-c757-51e7-ad75-633138d47c0a with identifier: HU97464
2026-03-28 05:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ccc47a3-c757-51e7-ad75-633138d47c0a with identifier: HU97464 to the API
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:17:52Z',
 'fuel_type': 'diesel',
 'id': '8ccc47a3-c757-51e7-ad75-633138d47c0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU97464',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 83995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Saving data for HU97464: {'auction_closing_time': 1774714672.0, 'created_time': 1774552658.897763, 'last_price_update_time': 1774676127.825408}
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU97464') HTTP/1.1" 204 0
2026-03-28 05:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: VP80711
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: VH72223
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG77275%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for AG77275: 0
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: SB59394
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB59394%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for SB59394: 0
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: DY48174
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY48174%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for DY48174: 0
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for EU37880: 0
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for PA09921: 0
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for JT14864: 0
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: UY11294
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY11294%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for UY11294: 0
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: AB69673
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: HM40523
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM40523%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for HM40523: 0
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: YV51703
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: KA78171
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA78171%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for KA78171: 0
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL04579%27 HTTP/1.1" 200 None
2026-03-28 05:35:28 [auto1.de] INFO: Scrape type for AL04579: 0
2026-03-28 05:35:28 [auto1.de] INFO: Found listing with ID: BT69542
2026-03-28 05:35:28 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-28 05:35:28 [auto1.de] INFO: Scrape type for VR66334: 2
2026-03-28 05:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e023ed36-ac75-5635-8dbc-6190987645b5 with identifier: VR66334
2026-03-28 05:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e023ed36-ac75-5635-8dbc-6190987645b5 with scrape type 2
2026-03-28 05:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e023ed36-ac75-5635-8dbc-6190987645b5 with scrape type 2
2026-03-28 05:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e023ed36-ac75-5635-8dbc-6190987645b5, identifier: VR66334
2026-03-28 05:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e023ed36-ac75-5635-8dbc-6190987645b5 with identifier: VR66334
2026-03-28 05:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e023ed36-ac75-5635-8dbc-6190987645b5 with identifier: VR66334
2026-03-28 05:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e023ed36-ac75-5635-8dbc-6190987645b5 with identifier: VR66334 to the API
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:12:04Z',
 'fuel_type': 'diesel',
 'id': 'e023ed36-ac75-5635-8dbc-6190987645b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR66334',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 164553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-26',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-28 05:35:28 [auto1.de] INFO: Saving data for VR66334: {'auction_closing_time': 1774714324.0, 'created_time': 1774551865.827856, 'last_price_update_time': 1774676128.445841}
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR66334') HTTP/1.1" 204 0
2026-03-28 05:35:28 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-28 05:35:28 [auto1.de] INFO: Found listing with ID: YV26215
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV26215%27 HTTP/1.1" 200 None
2026-03-28 05:35:28 [auto1.de] INFO: Scrape type for YV26215: 0
2026-03-28 05:35:28 [auto1.de] INFO: Found listing with ID: AX44497
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX44497%27 HTTP/1.1" 200 None
2026-03-28 05:35:28 [auto1.de] INFO: Scrape type for AX44497: 2
2026-03-28 05:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f11f008-3edb-51b9-ad99-4daa2a183749 with identifier: AX44497
2026-03-28 05:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f11f008-3edb-51b9-ad99-4daa2a183749 with scrape type 2
2026-03-28 05:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f11f008-3edb-51b9-ad99-4daa2a183749 with scrape type 2
2026-03-28 05:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f11f008-3edb-51b9-ad99-4daa2a183749, identifier: AX44497
2026-03-28 05:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f11f008-3edb-51b9-ad99-4daa2a183749 with identifier: AX44497
2026-03-28 05:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f11f008-3edb-51b9-ad99-4daa2a183749 with identifier: AX44497
2026-03-28 05:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f11f008-3edb-51b9-ad99-4daa2a183749 with identifier: AX44497 to the API
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:00:52Z',
 'fuel_type': 'diesel',
 'id': '0f11f008-3edb-51b9-ad99-4daa2a183749',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX44497',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4 Crossback',
 'odometer': 113110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-19',
 'seller_name': None,
 'title': 'DS Automobiles DS4 Crossback 2.0 Blue-HDi',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX44497%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Saving data for AX44497: {'auction_closing_time': 1774713652.0, 'created_time': 1774466752.745794, 'last_price_update_time': 1774676129.05069}
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX44497') HTTP/1.1" 204 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: JT36836
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT36836%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for JT36836: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: SS40295
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS40295%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for SS40295: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: DS42443
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: SD15170
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for TF08287: 2
2026-03-28 05:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287
2026-03-28 05:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48f2d600-0ecc-591c-8871-98bb0a62dfaf with scrape type 2
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48f2d600-0ecc-591c-8871-98bb0a62dfaf with scrape type 2
2026-03-28 05:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48f2d600-0ecc-591c-8871-98bb0a62dfaf, identifier: TF08287
2026-03-28 05:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287
2026-03-28 05:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287
2026-03-28 05:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287 to the API
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:58:39Z',
 'fuel_type': 'petrol',
 'id': '48f2d600-0ecc-591c-8871-98bb0a62dfaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF08287',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A2',
 'odometer': 247755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-08-14',
 'seller_name': None,
 'title': 'Audi A2 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Saving data for TF08287: {'auction_closing_time': 1774717119.0, 'created_time': 1774550473.956987, 'last_price_update_time': 1774676129.559786}
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF08287') HTTP/1.1" 204 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: GE10245
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for WX73478: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: PW24553
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: JC94959
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC94959%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for JC94959: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: YT48506
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48506%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for YT48506: 2
2026-03-28 05:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba0fa4d-ecd2-5d81-a20f-517e7a29b324 with identifier: YT48506
2026-03-28 05:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ba0fa4d-ecd2-5d81-a20f-517e7a29b324 with scrape type 2
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ba0fa4d-ecd2-5d81-a20f-517e7a29b324 with scrape type 2
2026-03-28 05:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ba0fa4d-ecd2-5d81-a20f-517e7a29b324, identifier: YT48506
2026-03-28 05:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ba0fa4d-ecd2-5d81-a20f-517e7a29b324 with identifier: YT48506
2026-03-28 05:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ba0fa4d-ecd2-5d81-a20f-517e7a29b324 with identifier: YT48506
2026-03-28 05:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ba0fa4d-ecd2-5d81-a20f-517e7a29b324 with identifier: YT48506 to the API
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:16:48Z',
 'fuel_type': 'diesel',
 'id': '3ba0fa4d-ecd2-5d81-a20f-517e7a29b324',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT48506',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 115606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seller_name': None,
 'title': 'BMW 5er 530d Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2021}
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48506%27 HTTP/1.1" 200 None
2026-03-28 05:35:30 [auto1.de] INFO: Saving data for YT48506: {'auction_closing_time': 1774714608.0, 'created_time': 1774463864.598465, 'last_price_update_time': 1774676130.113213}
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT48506') HTTP/1.1" 204 0
2026-03-28 05:35:30 [auto1.de] INFO: Found listing with ID: TL31198
2026-03-28 05:35:30 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-28 05:35:30 [auto1.de] INFO: Found listing with ID: SW30333
2026-03-28 05:35:30 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-28 05:35:30 [auto1.de] INFO: Scrape type for KL19137: 2
2026-03-28 05:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5ec871b-e4ae-5785-b497-d4c3f98c44fa with identifier: KL19137
2026-03-28 05:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ec871b-e4ae-5785-b497-d4c3f98c44fa with scrape type 2
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5ec871b-e4ae-5785-b497-d4c3f98c44fa with scrape type 2
2026-03-28 05:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5ec871b-e4ae-5785-b497-d4c3f98c44fa, identifier: KL19137
2026-03-28 05:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5ec871b-e4ae-5785-b497-d4c3f98c44fa with identifier: KL19137
2026-03-28 05:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5ec871b-e4ae-5785-b497-d4c3f98c44fa with identifier: KL19137
2026-03-28 05:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5ec871b-e4ae-5785-b497-d4c3f98c44fa with identifier: KL19137 to the API
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:26:18Z',
 'fuel_type': 'hybrid',
 'id': 'c5ec871b-e4ae-5785-b497-d4c3f98c44fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL19137',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 124879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-07',
 'seller_name': None,
 'title': 'Audi Q5 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-28 05:35:30 [auto1.de] INFO: Saving data for KL19137: {'auction_closing_time': 1774715178.0, 'created_time': 1774552593.305863, 'last_price_update_time': 1774676130.666239}
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL19137') HTTP/1.1" 204 0
2026-03-28 05:35:30 [auto1.de] INFO: Found listing with ID: WP44552
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP44552%27 HTTP/1.1" 200 None
2026-03-28 05:35:30 [auto1.de] INFO: Scrape type for WP44552: 0
2026-03-28 05:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:31 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:31 [auto1.de] INFO: Found listing with ID: LK69228
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK69228%27 HTTP/1.1" 200 None
2026-03-28 05:35:31 [auto1.de] INFO: Scrape type for LK69228: 0
2026-03-28 05:35:31 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW42175%27 HTTP/1.1" 200 None
2026-03-28 05:35:31 [auto1.de] INFO: Scrape type for LW42175: 0
2026-03-28 05:35:31 [auto1.de] INFO: Found listing with ID: WL05450
2026-03-28 05:35:31 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD16858%27 HTTP/1.1" 200 None
2026-03-28 05:35:31 [auto1.de] INFO: Scrape type for BD16858: 0
2026-03-28 05:35:31 [auto1.de] INFO: Found listing with ID: KA31515
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA31515%27 HTTP/1.1" 200 None
2026-03-28 05:35:31 [auto1.de] INFO: Scrape type for KA31515: 0
2026-03-28 05:35:31 [auto1.de] INFO: Found listing with ID: JP52122
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP52122%27 HTTP/1.1" 200 None
2026-03-28 05:35:31 [auto1.de] INFO: Scrape type for JP52122: 0
2026-03-28 05:35:31 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-28 05:35:31 [auto1.de] INFO: Scrape type for BN76417: 2
2026-03-28 05:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417
2026-03-28 05:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb558e6-ec59-5f85-9dae-a97bfbeff81f with scrape type 2
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbb558e6-ec59-5f85-9dae-a97bfbeff81f with scrape type 2
2026-03-28 05:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbb558e6-ec59-5f85-9dae-a97bfbeff81f, identifier: BN76417
2026-03-28 05:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417
2026-03-28 05:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417
2026-03-28 05:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417 to the API
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:42:58Z',
 'fuel_type': 'petrol',
 'id': 'fbb558e6-ec59-5f85-9dae-a97bfbeff81f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN76417',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 175143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-10',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2013}
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-28 05:35:31 [auto1.de] INFO: Saving data for BN76417: {'auction_closing_time': 1774716178.0, 'created_time': 1774552639.452933, 'last_price_update_time': 1774676131.888529}
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN76417') HTTP/1.1" 204 0
2026-03-28 05:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: VU23200
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for CB40051: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: WB94414
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94414%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for WB94414: 2
2026-03-28 05:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68ffd85-b39a-5c8e-870c-0aecabef51f4 with identifier: WB94414
2026-03-28 05:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68ffd85-b39a-5c8e-870c-0aecabef51f4 with scrape type 2
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68ffd85-b39a-5c8e-870c-0aecabef51f4 with scrape type 2
2026-03-28 05:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d68ffd85-b39a-5c8e-870c-0aecabef51f4, identifier: WB94414
2026-03-28 05:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d68ffd85-b39a-5c8e-870c-0aecabef51f4 with identifier: WB94414
2026-03-28 05:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d68ffd85-b39a-5c8e-870c-0aecabef51f4 with identifier: WB94414
2026-03-28 05:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d68ffd85-b39a-5c8e-870c-0aecabef51f4 with identifier: WB94414 to the API
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:11:11Z',
 'fuel_type': 'petrol',
 'id': 'd68ffd85-b39a-5c8e-870c-0aecabef51f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB94414',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 52350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-04',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.6 Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Comfort 4x4',
 'year': 2017}
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94414%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Saving data for WB94414: {'auction_closing_time': 1774714271.0, 'created_time': 1774467930.699954, 'last_price_update_time': 1774676132.446773}
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB94414') HTTP/1.1" 204 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: GB35925
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB35925%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for GB35925: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: BY57485
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: GR15178
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15178%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for GR15178: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for GC08315: 2
2026-03-28 05:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 943a368f-5e49-52a4-b93e-d133bd320dcd with identifier: GC08315
2026-03-28 05:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 943a368f-5e49-52a4-b93e-d133bd320dcd with scrape type 2
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 943a368f-5e49-52a4-b93e-d133bd320dcd with scrape type 2
2026-03-28 05:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 943a368f-5e49-52a4-b93e-d133bd320dcd, identifier: GC08315
2026-03-28 05:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 943a368f-5e49-52a4-b93e-d133bd320dcd with identifier: GC08315
2026-03-28 05:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 943a368f-5e49-52a4-b93e-d133bd320dcd with identifier: GC08315
2026-03-28 05:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 943a368f-5e49-52a4-b93e-d133bd320dcd with identifier: GC08315 to the API
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-28T16:23:11Z',
 'fuel_type': 'petrol',
 'id': '943a368f-5e49-52a4-b93e-d133bd320dcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC08315',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 33300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [auto1.de] INFO: Saving data for GC08315: {'auction_closing_time': 1774714991.0, 'created_time': 1774552615.721608, 'last_price_update_time': 1774676133.014445}
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC08315') HTTP/1.1" 204 0
2026-03-28 05:35:33 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [auto1.de] INFO: Scrape type for VY10701: 2
2026-03-28 05:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701
2026-03-28 05:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28341f4f-64c1-54f7-96fc-3050898b0c78 with scrape type 2
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28341f4f-64c1-54f7-96fc-3050898b0c78 with scrape type 2
2026-03-28 05:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28341f4f-64c1-54f7-96fc-3050898b0c78, identifier: VY10701
2026-03-28 05:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701
2026-03-28 05:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701
2026-03-28 05:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701 to the API
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:35:43Z',
 'fuel_type': 'diesel',
 'id': '28341f4f-64c1-54f7-96fc-3050898b0c78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY10701',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 95881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-27',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2023}
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [auto1.de] INFO: Saving data for VY10701: {'auction_closing_time': 1774715743.0, 'created_time': 1774550721.033124, 'last_price_update_time': 1774676133.467281}
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY10701') HTTP/1.1" 204 0
2026-03-28 05:35:33 [auto1.de] INFO: Found listing with ID: HX50499
2026-03-28 05:35:33 [auto1.de] INFO: Found listing with ID: GV04450
2026-03-28 05:35:33 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [auto1.de] INFO: Scrape type for YK97708: 2
2026-03-28 05:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dced7bc2-531f-54ee-95bb-752d839be3d0 with identifier: YK97708
2026-03-28 05:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dced7bc2-531f-54ee-95bb-752d839be3d0 with scrape type 2
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dced7bc2-531f-54ee-95bb-752d839be3d0 with scrape type 2
2026-03-28 05:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dced7bc2-531f-54ee-95bb-752d839be3d0, identifier: YK97708
2026-03-28 05:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dced7bc2-531f-54ee-95bb-752d839be3d0 with identifier: YK97708
2026-03-28 05:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dced7bc2-531f-54ee-95bb-752d839be3d0 with identifier: YK97708
2026-03-28 05:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dced7bc2-531f-54ee-95bb-752d839be3d0 with identifier: YK97708 to the API
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:16:04Z',
 'fuel_type': 'petrol',
 'id': 'dced7bc2-531f-54ee-95bb-752d839be3d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK97708',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 45629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [auto1.de] INFO: Saving data for YK97708: {'auction_closing_time': 1774714564.0, 'created_time': 1774589459.395646, 'last_price_update_time': 1774676133.941853}
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK97708') HTTP/1.1" 204 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: NC07497
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: PM61322
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: FD42571
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD42571%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for FD42571: 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for MN48285: 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for NZ56847: 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM87462%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for XM87462: 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: HS15462
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS15462%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for HS15462: 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for YH76604: 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: GP04405
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP04405%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for GP04405: 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: FU27618
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: MS18045
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: NJ21212
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for FL30108: 2
2026-03-28 05:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52a025a5-8664-517c-86d3-39d1464312cd with identifier: FL30108
2026-03-28 05:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52a025a5-8664-517c-86d3-39d1464312cd with scrape type 2
2026-03-28 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52a025a5-8664-517c-86d3-39d1464312cd with scrape type 2
2026-03-28 05:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52a025a5-8664-517c-86d3-39d1464312cd, identifier: FL30108
2026-03-28 05:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52a025a5-8664-517c-86d3-39d1464312cd with identifier: FL30108
2026-03-28 05:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52a025a5-8664-517c-86d3-39d1464312cd with identifier: FL30108
2026-03-28 05:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52a025a5-8664-517c-86d3-39d1464312cd with identifier: FL30108 to the API
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:22:48Z',
 'fuel_type': 'petrol',
 'id': '52a025a5-8664-517c-86d3-39d1464312cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL30108',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 70712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-10',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Saving data for FL30108: {'auction_closing_time': 1774714968.0, 'created_time': 1774589459.046878, 'last_price_update_time': 1774676134.649896}
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL30108') HTTP/1.1" 204 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for KY92219: 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: WA59870
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for HZ51579: 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: PP05974
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP05974%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for PP05974: 0
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: YL90349
2026-03-28 05:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:34 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: SG28912
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: WL74765
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: RC95645
2026-03-28 05:35:34 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Scrape type for NG76002: 2
2026-03-28 05:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21738d5d-26fe-5565-be2a-aa5853066b04 with identifier: NG76002
2026-03-28 05:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21738d5d-26fe-5565-be2a-aa5853066b04 with scrape type 2
2026-03-28 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21738d5d-26fe-5565-be2a-aa5853066b04 with scrape type 2
2026-03-28 05:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21738d5d-26fe-5565-be2a-aa5853066b04, identifier: NG76002
2026-03-28 05:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21738d5d-26fe-5565-be2a-aa5853066b04 with identifier: NG76002
2026-03-28 05:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21738d5d-26fe-5565-be2a-aa5853066b04 with identifier: NG76002
2026-03-28 05:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21738d5d-26fe-5565-be2a-aa5853066b04 with identifier: NG76002 to the API
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:14Z',
 'fuel_type': 'diesel',
 'id': '21738d5d-26fe-5565-be2a-aa5853066b04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG76002',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 152714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-19',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion Tech',
 'year': 2017}
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [auto1.de] INFO: Saving data for NG76002: {'auction_closing_time': 1774714514.0, 'created_time': 1774552696.129057, 'last_price_update_time': 1774676135.369793}
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG76002') HTTP/1.1" 204 0
2026-03-28 05:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:35 [auto1.de] INFO: Found listing with ID: RE35722
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE35722%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [auto1.de] INFO: Scrape type for RE35722: 2
2026-03-28 05:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 676989ec-3ca7-57a0-a6e3-45cd996630e3 with identifier: RE35722
2026-03-28 05:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 676989ec-3ca7-57a0-a6e3-45cd996630e3 with scrape type 2
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 676989ec-3ca7-57a0-a6e3-45cd996630e3 with scrape type 2
2026-03-28 05:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 676989ec-3ca7-57a0-a6e3-45cd996630e3, identifier: RE35722
2026-03-28 05:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 676989ec-3ca7-57a0-a6e3-45cd996630e3 with identifier: RE35722
2026-03-28 05:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 676989ec-3ca7-57a0-a6e3-45cd996630e3 with identifier: RE35722
2026-03-28 05:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 676989ec-3ca7-57a0-a6e3-45cd996630e3 with identifier: RE35722 to the API
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:41:00Z',
 'fuel_type': 'diesel',
 'id': '676989ec-3ca7-57a0-a6e3-45cd996630e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE35722',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 257799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-28',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2004}
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE35722%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [auto1.de] INFO: Saving data for RE35722: {'auction_closing_time': 1774716060.0, 'created_time': 1772541098.869295, 'last_price_update_time': 1774676135.803868}
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE35722') HTTP/1.1" 204 0
2026-03-28 05:35:35 [auto1.de] INFO: Found listing with ID: YL65079
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL65079%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [auto1.de] INFO: Scrape type for YL65079: 0
2026-03-28 05:35:35 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-28 05:35:35 [auto1.de] INFO: Found listing with ID: WA93069
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA93069%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [auto1.de] INFO: Scrape type for WA93069: 2
2026-03-28 05:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bf1411c-b391-5cd3-8d06-262c526c817b with identifier: WA93069
2026-03-28 05:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf1411c-b391-5cd3-8d06-262c526c817b with scrape type 2
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bf1411c-b391-5cd3-8d06-262c526c817b with scrape type 2
2026-03-28 05:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bf1411c-b391-5cd3-8d06-262c526c817b, identifier: WA93069
2026-03-28 05:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bf1411c-b391-5cd3-8d06-262c526c817b with identifier: WA93069
2026-03-28 05:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bf1411c-b391-5cd3-8d06-262c526c817b with identifier: WA93069
2026-03-28 05:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bf1411c-b391-5cd3-8d06-262c526c817b with identifier: WA93069 to the API
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:09:59Z',
 'fuel_type': 'petrol',
 'id': '7bf1411c-b391-5cd3-8d06-262c526c817b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA93069',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 53615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-27',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 300 4Drive',
 'transmission': 'automatic',
 'trim': 'Cupra 300 4Drive',
 'year': 2019}
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA93069%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Saving data for WA93069: {'auction_closing_time': 1774714199.0, 'created_time': 1774464558.49698, 'last_price_update_time': 1774676136.259899}
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA93069') HTTP/1.1" 204 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: CV90861
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV90861%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for CV90861: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: MS18756
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: VG72700
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72700%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for VG72700: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: XJ79433
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: KR27506
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR27506%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for KR27506: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: NK01451
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: JR94106
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR94106%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for JR94106: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for SZ55877: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: ZS42490
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for DP85983: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: SC11687
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: XY56978
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: GK61319
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: DV16657
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV16657%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for DV16657: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: JM68743
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP89370%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for RP89370: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: KT67254
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT67254%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for KT67254: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: YD08284
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: TR81218
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: RS40797
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: CN04574
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN04574%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for CN04574: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: GT95785
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT95785%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for GT95785: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: ME08770
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME08770%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for ME08770: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: JZ46683
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: WT07379
2026-03-28 05:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:37 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:37 [auto1.de] INFO: Found listing with ID: BU09322
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU09322%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [auto1.de] INFO: Scrape type for BU09322: 2
2026-03-28 05:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27f6080b-b177-5c89-bc39-82be4c913490 with identifier: BU09322
2026-03-28 05:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27f6080b-b177-5c89-bc39-82be4c913490 with scrape type 2
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27f6080b-b177-5c89-bc39-82be4c913490 with scrape type 2
2026-03-28 05:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27f6080b-b177-5c89-bc39-82be4c913490, identifier: BU09322
2026-03-28 05:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27f6080b-b177-5c89-bc39-82be4c913490 with identifier: BU09322
2026-03-28 05:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27f6080b-b177-5c89-bc39-82be4c913490 with identifier: BU09322
2026-03-28 05:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27f6080b-b177-5c89-bc39-82be4c913490 with identifier: BU09322 to the API
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:56Z',
 'fuel_type': 'petrol',
 'id': '27f6080b-b177-5c89-bc39-82be4c913490',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU09322',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 137607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-18',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2016}
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU09322%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Saving data for BU09322: {'auction_closing_time': 1774715396.0, 'created_time': 1774552449.112451, 'last_price_update_time': 1774676138.181721}
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU09322') HTTP/1.1" 204 0
2026-03-28 05:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for YS02767: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: HZ43600
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for SA01659: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: TY52919
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY52919%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for TY52919: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for DE35783: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: RU06451
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06451%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for RU06451: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: YY05460
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for YH78241: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: FB23073
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB23073%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for FB23073: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: CZ24918
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: YR22562
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: GR85769
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR85769%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for GR85769: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: YF58476
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: FT39707
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT39707%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for FT39707: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: EL87499
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG27070%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for GG27070: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: ZG88444
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: EL37075
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for JB75617: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: GL08454
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL08454%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for GL08454: 0
2026-03-28 05:35:38 [auto1.de] INFO: Found listing with ID: UW91893
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW91893%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Scrape type for UW91893: 2
2026-03-28 05:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with identifier: UW91893
2026-03-28 05:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with scrape type 2
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with scrape type 2
2026-03-28 05:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93, identifier: UW91893
2026-03-28 05:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with identifier: UW91893
2026-03-28 05:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with identifier: UW91893
2026-03-28 05:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93 with identifier: UW91893 to the API
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:22:09Z',
 'fuel_type': 'diesel',
 'id': 'e6c5fbc6-16b6-5b8b-9d01-57e956ab0f93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW91893',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 207720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW91893%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Saving data for UW91893: {'auction_closing_time': 1774714929.0, 'created_time': 1773137303.542194, 'last_price_update_time': 1774676138.896922}
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW91893') HTTP/1.1" 204 0
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: CJ78227
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ78227%27 HTTP/1.1" 200 None
2026-03-28 05:35:39 [auto1.de] INFO: Scrape type for CJ78227: 0
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-28 05:35:39 [auto1.de] INFO: Scrape type for CU13937: 0
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: XW80989
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: DR71954
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR71954%27 HTTP/1.1" 200 None
2026-03-28 05:35:39 [auto1.de] INFO: Scrape type for DR71954: 0
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: SN40522
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: SY14600
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY14600%27 HTTP/1.1" 200 None
2026-03-28 05:35:39 [auto1.de] INFO: Scrape type for SY14600: 0
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: PH98737
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH98737%27 HTTP/1.1" 200 None
2026-03-28 05:35:39 [auto1.de] INFO: Scrape type for PH98737: 0
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: SF52194
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: VW86065
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW86065%27 HTTP/1.1" 200 None
2026-03-28 05:35:39 [auto1.de] INFO: Scrape type for VW86065: 0
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: VZ54866
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ54866%27 HTTP/1.1" 200 None
2026-03-28 05:35:39 [auto1.de] INFO: Scrape type for VZ54866: 0
2026-03-28 05:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:40 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: LA56471
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: TJ08431
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ08431%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for TJ08431: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: NZ84353
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ84353%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for NZ84353: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: ST39161
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: XY22197
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY22197%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for XY22197: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: WB34474
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB34474%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for WB34474: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for EG77695: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for TN32015: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: LZ81605
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ81605%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for LZ81605: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: CJ47476
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for JA27410: 2
2026-03-28 05:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410
2026-03-28 05:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcabcd04-cbe2-541d-93d7-8eda73afcd0e with scrape type 2
2026-03-28 05:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcabcd04-cbe2-541d-93d7-8eda73afcd0e with scrape type 2
2026-03-28 05:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcabcd04-cbe2-541d-93d7-8eda73afcd0e, identifier: JA27410
2026-03-28 05:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410
2026-03-28 05:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410
2026-03-28 05:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410 to the API
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:34:57Z',
 'fuel_type': 'petrol',
 'id': 'dcabcd04-cbe2-541d-93d7-8eda73afcd0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA27410',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 73032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'BMW 5er 540i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Saving data for JA27410: {'auction_closing_time': 1774715697.0, 'created_time': 1774552958.941099, 'last_price_update_time': 1774676140.5744}
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA27410') HTTP/1.1" 204 0
2026-03-28 05:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: AG51690
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS52652%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for PS52652: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: YM31567
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM31567%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for YM31567: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: CV85765
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV85765%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for CV85765: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: AG29521
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG29521%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for AG29521: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: AC43250
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55209%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for LV55209: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: PB72951
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB72951%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for PB72951: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: WM94615
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: LG52677
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG52677%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for LG52677: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: DB49845
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: FN07032
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: NZ83271
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ83271%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for NZ83271: 2
2026-03-28 05:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c18a5256-d9cd-576d-9413-6b6946017253 with identifier: NZ83271
2026-03-28 05:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c18a5256-d9cd-576d-9413-6b6946017253 with scrape type 2
2026-03-28 05:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c18a5256-d9cd-576d-9413-6b6946017253 with scrape type 2
2026-03-28 05:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c18a5256-d9cd-576d-9413-6b6946017253, identifier: NZ83271
2026-03-28 05:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c18a5256-d9cd-576d-9413-6b6946017253 with identifier: NZ83271
2026-03-28 05:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c18a5256-d9cd-576d-9413-6b6946017253 with identifier: NZ83271
2026-03-28 05:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c18a5256-d9cd-576d-9413-6b6946017253 with identifier: NZ83271 to the API
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:39:19Z',
 'fuel_type': 'diesel',
 'id': 'c18a5256-d9cd-576d-9413-6b6946017253',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ83271',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 156280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-21',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ83271%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Saving data for NZ83271: {'auction_closing_time': 1774715959.0, 'created_time': 1774463636.267474, 'last_price_update_time': 1774676141.261539}
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ83271') HTTP/1.1" 204 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: UF26861
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: ET42367
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET42367%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for ET42367: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: WG43761
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG43761%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for WG43761: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: SG57857
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: XN13180
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: JW06785
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW06785%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for JW06785: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: LE51560
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: KH68440
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH68440%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for KH68440: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: RA83567
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA83567%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for RA83567: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: BV43774
2026-03-28 05:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:42 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:42 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [auto1.de] INFO: Scrape type for TE58420: 2
2026-03-28 05:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0508104-735e-5d16-86d7-200a5cb885a1 with identifier: TE58420
2026-03-28 05:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0508104-735e-5d16-86d7-200a5cb885a1 with scrape type 2
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0508104-735e-5d16-86d7-200a5cb885a1 with scrape type 2
2026-03-28 05:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0508104-735e-5d16-86d7-200a5cb885a1, identifier: TE58420
2026-03-28 05:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0508104-735e-5d16-86d7-200a5cb885a1 with identifier: TE58420
2026-03-28 05:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0508104-735e-5d16-86d7-200a5cb885a1 with identifier: TE58420
2026-03-28 05:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0508104-735e-5d16-86d7-200a5cb885a1 with identifier: TE58420 to the API
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:19:23Z',
 'fuel_type': 'diesel',
 'id': 'c0508104-735e-5d16-86d7-200a5cb885a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE58420',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 205823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-05',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 108 CDI Lang Worker',
 'transmission': 'manual',
 'trim': 'Lang Worker',
 'year': 2014}
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Saving data for TE58420: {'auction_closing_time': 1774714763.0, 'created_time': 1774552508.328908, 'last_price_update_time': 1774676143.385266}
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE58420') HTTP/1.1" 204 0
2026-03-28 05:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: XP05146
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for MP68485: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: JH33807
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for VL78522: 2
2026-03-28 05:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0303fe60-6d6d-510d-bd82-f60a02aa7341 with identifier: VL78522
2026-03-28 05:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0303fe60-6d6d-510d-bd82-f60a02aa7341 with scrape type 2
2026-03-28 05:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0303fe60-6d6d-510d-bd82-f60a02aa7341 with scrape type 2
2026-03-28 05:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0303fe60-6d6d-510d-bd82-f60a02aa7341, identifier: VL78522
2026-03-28 05:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0303fe60-6d6d-510d-bd82-f60a02aa7341 with identifier: VL78522
2026-03-28 05:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0303fe60-6d6d-510d-bd82-f60a02aa7341 with identifier: VL78522
2026-03-28 05:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0303fe60-6d6d-510d-bd82-f60a02aa7341 with identifier: VL78522 to the API
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:08:05Z',
 'fuel_type': 'petrol',
 'id': '0303fe60-6d6d-510d-bd82-f60a02aa7341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL78522',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 80039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-24',
 'seller_name': None,
 'title': 'Smart forfour 0.9 Turbo Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2019}
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Saving data for VL78522: {'auction_closing_time': 1774714085.0, 'created_time': 1774552964.218711, 'last_price_update_time': 1774676143.928426}
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL78522') HTTP/1.1" 204 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: UM56474
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: DU13995
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13995%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for DU13995: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: NV07015
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV07015%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for NV07015: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for UN58886: 2
2026-03-28 05:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886
2026-03-28 05:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0836e142-c706-50e8-97c6-715cd094342e with scrape type 2
2026-03-28 05:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0836e142-c706-50e8-97c6-715cd094342e with scrape type 2
2026-03-28 05:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0836e142-c706-50e8-97c6-715cd094342e, identifier: UN58886
2026-03-28 05:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886
2026-03-28 05:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886
2026-03-28 05:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886 to the API
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:58:47Z',
 'fuel_type': 'petrol',
 'id': '0836e142-c706-50e8-97c6-715cd094342e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN58886',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 113829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-23',
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Saving data for UN58886: {'auction_closing_time': 1774717127.0, 'created_time': 1774589450.978319, 'last_price_update_time': 1774676144.3904}
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN58886') HTTP/1.1" 204 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: LU68586
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU68586%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for LU68586: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: AA62808
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for AP20693: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: UR01748
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR01748%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for UR01748: 2
2026-03-28 05:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecfe7f44-b127-5d89-9ea6-d2a54e791419 with identifier: UR01748
2026-03-28 05:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecfe7f44-b127-5d89-9ea6-d2a54e791419 with scrape type 2
2026-03-28 05:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecfe7f44-b127-5d89-9ea6-d2a54e791419 with scrape type 2
2026-03-28 05:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecfe7f44-b127-5d89-9ea6-d2a54e791419, identifier: UR01748
2026-03-28 05:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecfe7f44-b127-5d89-9ea6-d2a54e791419 with identifier: UR01748
2026-03-28 05:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecfe7f44-b127-5d89-9ea6-d2a54e791419 with identifier: UR01748
2026-03-28 05:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecfe7f44-b127-5d89-9ea6-d2a54e791419 with identifier: UR01748 to the API
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:18:36Z',
 'fuel_type': 'petrol',
 'id': 'ecfe7f44-b127-5d89-9ea6-d2a54e791419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR01748',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 125431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-06',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2014}
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR01748%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Saving data for UR01748: {'auction_closing_time': 1774714716.0, 'created_time': 1774503050.728095, 'last_price_update_time': 1774676144.882393}
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR01748') HTTP/1.1" 204 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: KA74482
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA74482%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for KA74482: 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: ZJ08757
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ08757%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for ZJ08757: 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: PR12884
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for BT37883: 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for PC60688: 2
2026-03-28 05:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: effb8867-b24a-51eb-ba75-c8f28700d8cd with identifier: PC60688
2026-03-28 05:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item effb8867-b24a-51eb-ba75-c8f28700d8cd with scrape type 2
2026-03-28 05:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item effb8867-b24a-51eb-ba75-c8f28700d8cd with scrape type 2
2026-03-28 05:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: effb8867-b24a-51eb-ba75-c8f28700d8cd, identifier: PC60688
2026-03-28 05:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: effb8867-b24a-51eb-ba75-c8f28700d8cd with identifier: PC60688
2026-03-28 05:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: effb8867-b24a-51eb-ba75-c8f28700d8cd with identifier: PC60688
2026-03-28 05:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: effb8867-b24a-51eb-ba75-c8f28700d8cd with identifier: PC60688 to the API
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:20:32Z',
 'fuel_type': 'diesel',
 'id': 'effb8867-b24a-51eb-ba75-c8f28700d8cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC60688',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 162569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-01',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Trend blue',
 'transmission': 'manual',
 'trim': 'Trend blue',
 'year': 2015}
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Saving data for PC60688: {'auction_closing_time': 1774714832.0, 'created_time': 1774550641.811672, 'last_price_update_time': 1774676145.449257}
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC60688') HTTP/1.1" 204 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: NT99648
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: YS92779
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: XH94103
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for LS49952: 2
2026-03-28 05:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952
2026-03-28 05:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be26a880-c042-5db3-a95f-1b22f9a4e33d with scrape type 2
2026-03-28 05:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be26a880-c042-5db3-a95f-1b22f9a4e33d with scrape type 2
2026-03-28 05:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be26a880-c042-5db3-a95f-1b22f9a4e33d, identifier: LS49952
2026-03-28 05:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952
2026-03-28 05:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952
2026-03-28 05:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952 to the API
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:42:28Z',
 'fuel_type': 'diesel',
 'id': 'be26a880-c042-5db3-a95f-1b22f9a4e33d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS49952',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 144757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-24',
 'seller_name': None,
 'title': 'Opel Grandland X 1.5 CDTI INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Saving data for LS49952: {'auction_closing_time': 1774716148.0, 'created_time': 1773307326.541621, 'last_price_update_time': 1774676145.874785}
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS49952') HTTP/1.1" 204 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: TS84249
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: JJ89633
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: FJ28912
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ28912%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for FJ28912: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: WK04531
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK04531%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for WK04531: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: NX49590
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX49590%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for NX49590: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: CK76126
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK76126%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for CK76126: 2
2026-03-28 05:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 406d56be-3685-5fd9-ae3c-2526056a90a1 with identifier: CK76126
2026-03-28 05:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 406d56be-3685-5fd9-ae3c-2526056a90a1 with scrape type 2
2026-03-28 05:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 406d56be-3685-5fd9-ae3c-2526056a90a1 with scrape type 2
2026-03-28 05:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 406d56be-3685-5fd9-ae3c-2526056a90a1, identifier: CK76126
2026-03-28 05:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 406d56be-3685-5fd9-ae3c-2526056a90a1 with identifier: CK76126
2026-03-28 05:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 406d56be-3685-5fd9-ae3c-2526056a90a1 with identifier: CK76126
2026-03-28 05:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 406d56be-3685-5fd9-ae3c-2526056a90a1 with identifier: CK76126 to the API
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:45:35Z',
 'fuel_type': 'diesel',
 'id': '406d56be-3685-5fd9-ae3c-2526056a90a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK76126',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 155977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2019}
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK76126%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Saving data for CK76126: {'auction_closing_time': 1774716335.0, 'created_time': 1774467992.980498, 'last_price_update_time': 1774676146.476035}
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK76126') HTTP/1.1" 204 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: PM90514
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for TT68659: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: EA46191
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA46191%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for EA46191: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC63229%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for LC63229: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: YD12708
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12708%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for YD12708: 2
2026-03-28 05:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf02823d-809c-5592-ae50-f049c1ab8c6a with identifier: YD12708
2026-03-28 05:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf02823d-809c-5592-ae50-f049c1ab8c6a with scrape type 2
2026-03-28 05:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf02823d-809c-5592-ae50-f049c1ab8c6a with scrape type 2
2026-03-28 05:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf02823d-809c-5592-ae50-f049c1ab8c6a, identifier: YD12708
2026-03-28 05:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf02823d-809c-5592-ae50-f049c1ab8c6a with identifier: YD12708
2026-03-28 05:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf02823d-809c-5592-ae50-f049c1ab8c6a with identifier: YD12708
2026-03-28 05:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf02823d-809c-5592-ae50-f049c1ab8c6a with identifier: YD12708 to the API
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:12:13Z',
 'fuel_type': 'diesel',
 'id': 'cf02823d-809c-5592-ae50-f049c1ab8c6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD12708',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 58699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'Jaguar E-Pace D240 R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2018}
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12708%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Saving data for YD12708: {'auction_closing_time': 1774714333.0, 'created_time': 1774467848.812588, 'last_price_update_time': 1774676147.01325}
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD12708') HTTP/1.1" 204 0
2026-03-28 05:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:47 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: SF95135
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: GW25108
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW25108%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for GW25108: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for ND58698: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: YK99793
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99793%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for YK99793: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: BF84298
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF84298%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for BF84298: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: KT12333
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT12333%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for KT12333: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: SE74775
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE74775%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for SE74775: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: RL13206
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: VR66092
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66092%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for VR66092: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14877%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for BY14877: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: UC83372
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83372%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for UC83372: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: MR23969
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: JV02966
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: LN11625
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11625%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for LN11625: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for TK27520: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: CJ75099
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75099%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for CJ75099: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for WN20430: 2
2026-03-28 05:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with identifier: WN20430
2026-03-28 05:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with scrape type 2
2026-03-28 05:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with scrape type 2
2026-03-28 05:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d327382-3ce5-5c8f-bae1-5b97ce914a76, identifier: WN20430
2026-03-28 05:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with identifier: WN20430
2026-03-28 05:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with identifier: WN20430
2026-03-28 05:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with identifier: WN20430 to the API
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:14:13Z',
 'fuel_type': 'diesel',
 'id': '8d327382-3ce5-5c8f-bae1-5b97ce914a76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN20430',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 193056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Saving data for WN20430: {'auction_closing_time': 1774714453.0, 'created_time': 1774550420.211448, 'last_price_update_time': 1774676147.882881}
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN20430') HTTP/1.1" 204 0
2026-03-28 05:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-28 05:35:48 [auto1.de] INFO: Scrape type for WE79254: 2
2026-03-28 05:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254
2026-03-28 05:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39ebb7c2-9354-5580-a69b-c618da39f6c0 with scrape type 2
2026-03-28 05:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39ebb7c2-9354-5580-a69b-c618da39f6c0 with scrape type 2
2026-03-28 05:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39ebb7c2-9354-5580-a69b-c618da39f6c0, identifier: WE79254
2026-03-28 05:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254
2026-03-28 05:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254
2026-03-28 05:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254 to the API
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:44:29Z',
 'fuel_type': 'petrol',
 'id': '39ebb7c2-9354-5580-a69b-c618da39f6c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE79254',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 171097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2013}
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-28 05:35:48 [auto1.de] INFO: Saving data for WE79254: {'auction_closing_time': 1774716269.0, 'created_time': 1774552896.025092, 'last_price_update_time': 1774676148.420874}
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE79254') HTTP/1.1" 204 0
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: GV90609
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV90609%27 HTTP/1.1" 200 None
2026-03-28 05:35:48 [auto1.de] INFO: Scrape type for GV90609: 2
2026-03-28 05:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f19599e-506d-5b7a-a36a-7d29f54fbfa9 with identifier: GV90609
2026-03-28 05:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f19599e-506d-5b7a-a36a-7d29f54fbfa9 with scrape type 2
2026-03-28 05:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f19599e-506d-5b7a-a36a-7d29f54fbfa9 with scrape type 2
2026-03-28 05:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f19599e-506d-5b7a-a36a-7d29f54fbfa9, identifier: GV90609
2026-03-28 05:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f19599e-506d-5b7a-a36a-7d29f54fbfa9 with identifier: GV90609
2026-03-28 05:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f19599e-506d-5b7a-a36a-7d29f54fbfa9 with identifier: GV90609
2026-03-28 05:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f19599e-506d-5b7a-a36a-7d29f54fbfa9 with identifier: GV90609 to the API
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:10:24Z',
 'fuel_type': 'petrol',
 'id': '9f19599e-506d-5b7a-a36a-7d29f54fbfa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV90609',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 150740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-25',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV90609%27 HTTP/1.1" 200 None
2026-03-28 05:35:48 [auto1.de] INFO: Saving data for GV90609: {'auction_closing_time': 1774714224.0, 'created_time': 1774463661.512972, 'last_price_update_time': 1774676148.856253}
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV90609') HTTP/1.1" 204 0
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: NA81558
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA81558%27 HTTP/1.1" 200 None
2026-03-28 05:35:48 [auto1.de] INFO: Scrape type for NA81558: 0
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: RP40821
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP40821%27 HTTP/1.1" 200 None
2026-03-28 05:35:48 [auto1.de] INFO: Scrape type for RP40821: 0
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: PB76196
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-28 05:35:48 [auto1.de] INFO: Scrape type for XU28434: 0
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: YB31045
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: WJ62953
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: GN74176
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN74176%27 HTTP/1.1" 200 None
2026-03-28 05:35:48 [auto1.de] INFO: Scrape type for GN74176: 0
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: KT54325
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT54325%27 HTTP/1.1" 200 None
2026-03-28 05:35:48 [auto1.de] INFO: Scrape type for KT54325: 2
2026-03-28 05:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f000d2c-03d8-5d0a-b45c-c33a48388292 with identifier: KT54325
2026-03-28 05:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f000d2c-03d8-5d0a-b45c-c33a48388292 with scrape type 2
2026-03-28 05:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f000d2c-03d8-5d0a-b45c-c33a48388292 with scrape type 2
2026-03-28 05:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f000d2c-03d8-5d0a-b45c-c33a48388292, identifier: KT54325
2026-03-28 05:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f000d2c-03d8-5d0a-b45c-c33a48388292 with identifier: KT54325
2026-03-28 05:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f000d2c-03d8-5d0a-b45c-c33a48388292 with identifier: KT54325
2026-03-28 05:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f000d2c-03d8-5d0a-b45c-c33a48388292 with identifier: KT54325 to the API
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:52:08Z',
 'fuel_type': 'petrol',
 'id': '5f000d2c-03d8-5d0a-b45c-c33a48388292',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT54325',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 180146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-19',
 'seller_name': None,
 'title': 'Land Rover Freelander 2.0 Turbo I4 SE',
 'transmission': 'automatic',
 'trim': 'I4 SE',
 'year': 2012}
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT54325%27 HTTP/1.1" 200 None
2026-03-28 05:35:49 [auto1.de] INFO: Saving data for KT54325: {'auction_closing_time': 1774716728.0, 'created_time': 1774553019.125002, 'last_price_update_time': 1774676149.369196}
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT54325') HTTP/1.1" 204 0
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: RR48020
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: YT23335
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23335%27 HTTP/1.1" 200 None
2026-03-28 05:35:49 [auto1.de] INFO: Scrape type for YT23335: 0
2026-03-28 05:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:50 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:50 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-28 05:35:50 [auto1.de] INFO: Scrape type for LK79875: 0
2026-03-28 05:35:50 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-28 05:35:50 [auto1.de] INFO: Found listing with ID: WD80617
2026-03-28 05:35:50 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-28 05:35:50 [auto1.de] INFO: Scrape type for ZF45936: 2
2026-03-28 05:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936
2026-03-28 05:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with scrape type 2
2026-03-28 05:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with scrape type 2
2026-03-28 05:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e, identifier: ZF45936
2026-03-28 05:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936
2026-03-28 05:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936
2026-03-28 05:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936 to the API
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:51Z',
 'fuel_type': 'petrol',
 'id': '9d33e5ad-e765-5837-b46a-c3f52bd04b8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF45936',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 73602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-30',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2020}
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Saving data for ZF45936: {'auction_closing_time': 1774715751.0, 'created_time': 1774550428.152798, 'last_price_update_time': 1774676151.125163}
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF45936') HTTP/1.1" 204 0
2026-03-28 05:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: BX28873
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX28873%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Scrape type for BX28873: 0
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: VK38709
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: JH99279
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: YR20535
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR20535%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Scrape type for YR20535: 0
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: RY66150
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY66150%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Scrape type for RY66150: 0
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Scrape type for YD60070: 2
2026-03-28 05:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070
2026-03-28 05:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d97d0e12-9ca1-581c-a761-e4df19eef248 with scrape type 2
2026-03-28 05:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d97d0e12-9ca1-581c-a761-e4df19eef248 with scrape type 2
2026-03-28 05:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d97d0e12-9ca1-581c-a761-e4df19eef248, identifier: YD60070
2026-03-28 05:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070
2026-03-28 05:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070
2026-03-28 05:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070 to the API
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:32:55Z',
 'fuel_type': 'petrol',
 'id': 'd97d0e12-9ca1-581c-a761-e4df19eef248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD60070',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 48763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-18',
 'seller_name': None,
 'title': 'BMW Z4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Saving data for YD60070: {'auction_closing_time': 1774715575.0, 'created_time': 1774552186.469334, 'last_price_update_time': 1774676151.632253}
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD60070') HTTP/1.1" 204 0
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: CJ93593
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ93593%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Scrape type for CJ93593: 0
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE09652%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Scrape type for PE09652: 0
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Scrape type for DF95353: 2
2026-03-28 05:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353
2026-03-28 05:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b73d08a5-dd75-5f7c-9eca-e6714f372d56 with scrape type 2
2026-03-28 05:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b73d08a5-dd75-5f7c-9eca-e6714f372d56 with scrape type 2
2026-03-28 05:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b73d08a5-dd75-5f7c-9eca-e6714f372d56, identifier: DF95353
2026-03-28 05:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353
2026-03-28 05:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353
2026-03-28 05:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353 to the API
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:43:41Z',
 'fuel_type': 'petrol',
 'id': 'b73d08a5-dd75-5f7c-9eca-e6714f372d56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF95353',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 76657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-24',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 TGDI Black Xdition',
 'transmission': 'automatic',
 'trim': 'Black Xdition',
 'year': 2021}
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-28 05:35:52 [auto1.de] INFO: Saving data for DF95353: {'auction_closing_time': 1774716221.0, 'created_time': 1774552505.025691, 'last_price_update_time': 1774676152.231025}
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF95353') HTTP/1.1" 204 0
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: FW21815
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: YL37879
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: MC30685
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-28 05:35:52 [auto1.de] INFO: Scrape type for TX40951: 0
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: DL80875
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-28 05:35:52 [auto1.de] INFO: Scrape type for JD76793: 2
2026-03-28 05:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c486f9-b256-55b6-a737-688a2d950b31 with identifier: JD76793
2026-03-28 05:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c486f9-b256-55b6-a737-688a2d950b31 with scrape type 2
2026-03-28 05:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c486f9-b256-55b6-a737-688a2d950b31 with scrape type 2
2026-03-28 05:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54c486f9-b256-55b6-a737-688a2d950b31, identifier: JD76793
2026-03-28 05:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54c486f9-b256-55b6-a737-688a2d950b31 with identifier: JD76793
2026-03-28 05:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54c486f9-b256-55b6-a737-688a2d950b31 with identifier: JD76793
2026-03-28 05:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54c486f9-b256-55b6-a737-688a2d950b31 with identifier: JD76793 to the API
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:08:57Z',
 'fuel_type': 'petrol',
 'id': '54c486f9-b256-55b6-a737-688a2d950b31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD76793',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Lupo',
 'odometer': 159786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-19',
 'seller_name': None,
 'title': 'Volkswagen Lupo 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Saving data for JD76793: {'auction_closing_time': 1774714137.0, 'created_time': 1774552909.202751, 'last_price_update_time': 1774676153.393015}
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD76793') HTTP/1.1" 204 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: AP12446
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP12446%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for AP12446: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: KE84614
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE84614%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for KE84614: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: VJ09038
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: FD89715
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: PF74105
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF74105%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for PF74105: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: ZX76617
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: VH66319
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: ME61701
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for NZ68458: 2
2026-03-28 05:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f86ac1-ef20-5b61-821b-7f331a3f1868 with identifier: NZ68458
2026-03-28 05:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f86ac1-ef20-5b61-821b-7f331a3f1868 with scrape type 2
2026-03-28 05:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f86ac1-ef20-5b61-821b-7f331a3f1868 with scrape type 2
2026-03-28 05:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17f86ac1-ef20-5b61-821b-7f331a3f1868, identifier: NZ68458
2026-03-28 05:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17f86ac1-ef20-5b61-821b-7f331a3f1868 with identifier: NZ68458
2026-03-28 05:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17f86ac1-ef20-5b61-821b-7f331a3f1868 with identifier: NZ68458
2026-03-28 05:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17f86ac1-ef20-5b61-821b-7f331a3f1868 with identifier: NZ68458 to the API
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:04:37Z',
 'fuel_type': 'diesel',
 'id': '17f86ac1-ef20-5b61-821b-7f331a3f1868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ68458',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 219287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-10',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Saving data for NZ68458: {'auction_closing_time': 1774713877.0, 'created_time': 1774550443.938862, 'last_price_update_time': 1774676153.978623}
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ68458') HTTP/1.1" 204 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: CW02492
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: PN40620
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN40620%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Scrape type for PN40620: 0
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: ER00491
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER00491%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Scrape type for ER00491: 0
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: PX22927
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: RY31497
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: NR66161
2026-03-28 05:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:54 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Scrape type for WR53064: 2
2026-03-28 05:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064
2026-03-28 05:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb153bde-d42a-5581-83ea-3a0cd6c4c086 with scrape type 2
2026-03-28 05:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb153bde-d42a-5581-83ea-3a0cd6c4c086 with scrape type 2
2026-03-28 05:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb153bde-d42a-5581-83ea-3a0cd6c4c086, identifier: WR53064
2026-03-28 05:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064
2026-03-28 05:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064
2026-03-28 05:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064 to the API
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:38:04Z',
 'fuel_type': 'diesel',
 'id': 'fb153bde-d42a-5581-83ea-3a0cd6c4c086',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR53064',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 162720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Team BlueMotion',
 'transmission': 'manual',
 'trim': 'Team BlueMotion',
 'year': 2011}
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-28 05:35:55 [auto1.de] INFO: Saving data for WR53064: {'auction_closing_time': 1774715884.0, 'created_time': 1774550635.424659, 'last_price_update_time': 1774676155.255256}
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR53064') HTTP/1.1" 204 0
2026-03-28 05:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:55 [auto1.de] INFO: Found listing with ID: JJ67232
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ67232%27 HTTP/1.1" 200 None
2026-03-28 05:35:55 [auto1.de] INFO: Scrape type for JJ67232: 0
2026-03-28 05:35:55 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-28 05:35:55 [auto1.de] INFO: Found listing with ID: KZ45391
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ45391%27 HTTP/1.1" 200 None
2026-03-28 05:35:55 [auto1.de] INFO: Scrape type for KZ45391: 0
2026-03-28 05:35:55 [auto1.de] INFO: Found listing with ID: PA67996
2026-03-28 05:35:55 [auto1.de] INFO: Found listing with ID: VC74515
2026-03-28 05:35:55 [auto1.de] INFO: Found listing with ID: WW75764
2026-03-28 05:35:55 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-28 05:35:55 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-28 05:35:55 [auto1.de] INFO: Scrape type for RT01969: 2
2026-03-28 05:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969
2026-03-28 05:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b67095-709f-5552-a472-895acbcfb0f7 with scrape type 2
2026-03-28 05:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21b67095-709f-5552-a472-895acbcfb0f7 with scrape type 2
2026-03-28 05:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21b67095-709f-5552-a472-895acbcfb0f7, identifier: RT01969
2026-03-28 05:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969
2026-03-28 05:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969
2026-03-28 05:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969 to the API
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:29:58Z',
 'fuel_type': 'petrol',
 'id': '21b67095-709f-5552-a472-895acbcfb0f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT01969',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 158610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-25',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-28 05:35:55 [auto1.de] INFO: Saving data for RT01969: {'auction_closing_time': 1774715398.0, 'created_time': 1773945735.005559, 'last_price_update_time': 1774676155.906908}
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT01969') HTTP/1.1" 204 0
2026-03-28 05:35:55 [auto1.de] INFO: Found listing with ID: VS51720
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS51720%27 HTTP/1.1" 200 None
2026-03-28 05:35:55 [auto1.de] INFO: Scrape type for VS51720: 0
2026-03-28 05:35:55 [auto1.de] INFO: Found listing with ID: BJ03544
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03544%27 HTTP/1.1" 200 None
2026-03-28 05:35:55 [auto1.de] INFO: Scrape type for BJ03544: 2
2026-03-28 05:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3d62754-d1fc-5c92-ba73-004c95ca0813 with identifier: BJ03544
2026-03-28 05:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d62754-d1fc-5c92-ba73-004c95ca0813 with scrape type 2
2026-03-28 05:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3d62754-d1fc-5c92-ba73-004c95ca0813 with scrape type 2
2026-03-28 05:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3d62754-d1fc-5c92-ba73-004c95ca0813, identifier: BJ03544
2026-03-28 05:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3d62754-d1fc-5c92-ba73-004c95ca0813 with identifier: BJ03544
2026-03-28 05:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3d62754-d1fc-5c92-ba73-004c95ca0813 with identifier: BJ03544
2026-03-28 05:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3d62754-d1fc-5c92-ba73-004c95ca0813 with identifier: BJ03544 to the API
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:46:26Z',
 'fuel_type': 'diesel',
 'id': 'd3d62754-d1fc-5c92-ba73-004c95ca0813',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ03544',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 180844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-22',
 'seller_name': None,
 'title': 'Opel Astra 2.0 CDTI Exklusiv',
 'transmission': 'automatic',
 'trim': 'Exklusiv',
 'year': 2014}
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03544%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Saving data for BJ03544: {'auction_closing_time': 1774716386.0, 'created_time': 1774465691.489696, 'last_price_update_time': 1774676156.34297}
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ03544') HTTP/1.1" 204 0
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: TZ46793
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for CX62190: 2
2026-03-28 05:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190
2026-03-28 05:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with scrape type 2
2026-03-28 05:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with scrape type 2
2026-03-28 05:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d, identifier: CX62190
2026-03-28 05:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190
2026-03-28 05:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190
2026-03-28 05:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190 to the API
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:20Z',
 'fuel_type': 'diesel',
 'id': 'bf8ae8c4-7d81-5714-9717-d9aaaae0d43d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX62190',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 123390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Saving data for CX62190: {'auction_closing_time': 1774715540.0, 'created_time': 1773917593.046965, 'last_price_update_time': 1774676156.795815}
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX62190') HTTP/1.1" 204 0
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: AJ07817
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ07817%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for AJ07817: 0
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: LR92682
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: JP07657
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: FA90244
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: FJ58055
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ58055%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for FJ58055: 0
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: TS29154
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: WC76278
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: VB04886
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB04886%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for VB04886: 0
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for XX76692: 2
2026-03-28 05:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf84834-7e36-5442-b103-6cca30555594 with identifier: XX76692
2026-03-28 05:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf84834-7e36-5442-b103-6cca30555594 with scrape type 2
2026-03-28 05:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdf84834-7e36-5442-b103-6cca30555594 with scrape type 2
2026-03-28 05:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdf84834-7e36-5442-b103-6cca30555594, identifier: XX76692
2026-03-28 05:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdf84834-7e36-5442-b103-6cca30555594 with identifier: XX76692
2026-03-28 05:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdf84834-7e36-5442-b103-6cca30555594 with identifier: XX76692
2026-03-28 05:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdf84834-7e36-5442-b103-6cca30555594 with identifier: XX76692 to the API
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:27:36Z',
 'fuel_type': 'diesel',
 'id': 'bdf84834-7e36-5442-b103-6cca30555594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX76692',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 324257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-21',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CDI T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2014}
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Saving data for XX76692: {'auction_closing_time': 1774715256.0, 'created_time': 1773945087.443826, 'last_price_update_time': 1774676157.39925}
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX76692') HTTP/1.1" 204 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for JN99222: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: US78573
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27416%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for NT27416: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: CU60081
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: BB96456
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB96456%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for BB96456: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: AY98929
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY98929%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for AY98929: 2
2026-03-28 05:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42f4dfe1-fcf4-5230-9640-b0622a0ff9d0 with identifier: AY98929
2026-03-28 05:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42f4dfe1-fcf4-5230-9640-b0622a0ff9d0 with scrape type 2
2026-03-28 05:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42f4dfe1-fcf4-5230-9640-b0622a0ff9d0 with scrape type 2
2026-03-28 05:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42f4dfe1-fcf4-5230-9640-b0622a0ff9d0, identifier: AY98929
2026-03-28 05:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42f4dfe1-fcf4-5230-9640-b0622a0ff9d0 with identifier: AY98929
2026-03-28 05:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42f4dfe1-fcf4-5230-9640-b0622a0ff9d0 with identifier: AY98929
2026-03-28 05:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42f4dfe1-fcf4-5230-9640-b0622a0ff9d0 with identifier: AY98929 to the API
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:27:23Z',
 'fuel_type': 'petrol',
 'id': '42f4dfe1-fcf4-5230-9640-b0622a0ff9d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY98929',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 242684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-04-17',
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY98929%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Saving data for AY98929: {'auction_closing_time': 1774715243.0, 'created_time': 1774550763.277921, 'last_price_update_time': 1774676158.07657}
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY98929') HTTP/1.1" 204 0
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: LJ65322
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: PH74270
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: ZX03854
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Scrape type for JD13909: 0
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Scrape type for CM83282: 0
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: RD09031
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD09031%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Scrape type for RD09031: 0
2026-03-28 05:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:58 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: CZ43316
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ43316%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Scrape type for CZ43316: 2
2026-03-28 05:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4fbb78f-38cb-5b01-8e02-5adb4f27ad3d with identifier: CZ43316
2026-03-28 05:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4fbb78f-38cb-5b01-8e02-5adb4f27ad3d with scrape type 2
2026-03-28 05:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4fbb78f-38cb-5b01-8e02-5adb4f27ad3d with scrape type 2
2026-03-28 05:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4fbb78f-38cb-5b01-8e02-5adb4f27ad3d, identifier: CZ43316
2026-03-28 05:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4fbb78f-38cb-5b01-8e02-5adb4f27ad3d with identifier: CZ43316
2026-03-28 05:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4fbb78f-38cb-5b01-8e02-5adb4f27ad3d with identifier: CZ43316
2026-03-28 05:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4fbb78f-38cb-5b01-8e02-5adb4f27ad3d with identifier: CZ43316 to the API
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:30:58Z',
 'fuel_type': 'diesel',
 'id': 'e4fbb78f-38cb-5b01-8e02-5adb4f27ad3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ43316',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 257760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-01',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ43316%27 HTTP/1.1" 200 None
2026-03-28 05:35:59 [auto1.de] INFO: Saving data for CZ43316: {'auction_closing_time': 1774715458.0, 'created_time': 1774465720.787803, 'last_price_update_time': 1774676159.093652}
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ43316') HTTP/1.1" 204 0
2026-03-28 05:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:59 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-28 05:35:59 [auto1.de] INFO: Scrape type for EY98011: 2
2026-03-28 05:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with identifier: EY98011
2026-03-28 05:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with scrape type 2
2026-03-28 05:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with scrape type 2
2026-03-28 05:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1, identifier: EY98011
2026-03-28 05:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with identifier: EY98011
2026-03-28 05:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with identifier: EY98011
2026-03-28 05:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with identifier: EY98011 to the API
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:14:06Z',
 'fuel_type': 'diesel',
 'id': 'f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY98011',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Cross Tourer',
 'odometer': 167091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-14',
 'seller_name': None,
 'title': 'Citroen C5 Cross Tourer 2.0 Blue-HDi',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-28 05:35:59 [auto1.de] INFO: Saving data for EY98011: {'auction_closing_time': 1774714446.0, 'created_time': 1774550879.580074, 'last_price_update_time': 1774676159.612723}
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY98011') HTTP/1.1" 204 0
2026-03-28 05:35:59 [auto1.de] INFO: Found listing with ID: PB95967
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB95967%27 HTTP/1.1" 200 None
2026-03-28 05:35:59 [auto1.de] INFO: Scrape type for PB95967: 2
2026-03-28 05:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a6b146b-f2c2-5468-8e05-5107a15a265f with identifier: PB95967
2026-03-28 05:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a6b146b-f2c2-5468-8e05-5107a15a265f with scrape type 2
2026-03-28 05:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a6b146b-f2c2-5468-8e05-5107a15a265f with scrape type 2
2026-03-28 05:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a6b146b-f2c2-5468-8e05-5107a15a265f, identifier: PB95967
2026-03-28 05:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a6b146b-f2c2-5468-8e05-5107a15a265f with identifier: PB95967
2026-03-28 05:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a6b146b-f2c2-5468-8e05-5107a15a265f with identifier: PB95967
2026-03-28 05:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a6b146b-f2c2-5468-8e05-5107a15a265f with identifier: PB95967 to the API
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:11:42Z',
 'fuel_type': 'diesel',
 'id': '1a6b146b-f2c2-5468-8e05-5107a15a265f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB95967',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 161464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-29',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'BlueMotion 4Motion',
 'year': 2012}
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB95967%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Saving data for PB95967: {'auction_closing_time': 1774714302.0, 'created_time': 1774552039.055933, 'last_price_update_time': 1774676160.087561}
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB95967') HTTP/1.1" 204 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for WJ04835: 2
2026-03-28 05:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835
2026-03-28 05:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with scrape type 2
2026-03-28 05:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with scrape type 2
2026-03-28 05:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e53c585-b8c2-588f-a3f7-daeb8cda5687, identifier: WJ04835
2026-03-28 05:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835
2026-03-28 05:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835
2026-03-28 05:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835 to the API
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:46:37Z',
 'fuel_type': 'petrol',
 'id': '2e53c585-b8c2-588f-a3f7-daeb8cda5687',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ04835',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 79386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2017}
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Saving data for WJ04835: {'auction_closing_time': 1774716397.0, 'created_time': 1774552975.791394, 'last_price_update_time': 1774676160.529173}
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ04835') HTTP/1.1" 204 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: WD56041
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD56041%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for WD56041: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: CT53281
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA84823%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for MA84823: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: XE05025
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: UF59044
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF59044%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for UF59044: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: WX92371
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: KC84817
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: BM18767
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: SH08334
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH08334%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for SH08334: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: HE72355
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for PP85770: 2
2026-03-28 05:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with identifier: PP85770
2026-03-28 05:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with scrape type 2
2026-03-28 05:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with scrape type 2
2026-03-28 05:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7546b83f-d9c7-53eb-ab21-e2945c033dd0, identifier: PP85770
2026-03-28 05:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with identifier: PP85770
2026-03-28 05:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with identifier: PP85770
2026-03-28 05:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with identifier: PP85770 to the API
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 99,
 'expiration_date': '2026-03-28T16:28:39Z',
 'fuel_type': 'petrol',
 'id': '7546b83f-d9c7-53eb-ab21-e2945c033dd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP85770',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 34648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-13',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 MPI Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2020}
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-28 05:36:01 [auto1.de] INFO: Saving data for PP85770: {'auction_closing_time': 1774715319.0, 'created_time': 1774552662.571389, 'last_price_update_time': 1774676161.066528}
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP85770') HTTP/1.1" 204 0
2026-03-28 05:36:01 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-28 05:36:01 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-28 05:36:01 [auto1.de] INFO: Scrape type for AX39550: 2
2026-03-28 05:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47de7419-97f6-5517-9720-5b2a0a1603e9 with identifier: AX39550
2026-03-28 05:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47de7419-97f6-5517-9720-5b2a0a1603e9 with scrape type 2
2026-03-28 05:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47de7419-97f6-5517-9720-5b2a0a1603e9 with scrape type 2
2026-03-28 05:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47de7419-97f6-5517-9720-5b2a0a1603e9, identifier: AX39550
2026-03-28 05:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47de7419-97f6-5517-9720-5b2a0a1603e9 with identifier: AX39550
2026-03-28 05:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47de7419-97f6-5517-9720-5b2a0a1603e9 with identifier: AX39550
2026-03-28 05:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47de7419-97f6-5517-9720-5b2a0a1603e9 with identifier: AX39550 to the API
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:08:22Z',
 'fuel_type': 'petrol',
 'id': '47de7419-97f6-5517-9720-5b2a0a1603e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX39550',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 123093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-20',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Cup',
 'transmission': 'manual',
 'trim': 'Cup',
 'year': 2014}
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-28 05:36:01 [auto1.de] INFO: Saving data for AX39550: {'auction_closing_time': 1774714102.0, 'created_time': 1774550606.180922, 'last_price_update_time': 1774676161.603631}
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX39550') HTTP/1.1" 204 0
2026-03-28 05:36:01 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-28 05:36:01 [auto1.de] INFO: Found listing with ID: CN60683
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN60683%27 HTTP/1.1" 200 None
2026-03-28 05:36:01 [auto1.de] INFO: Scrape type for CN60683: 0
2026-03-28 05:36:01 [auto1.de] INFO: Found listing with ID: FD98026
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD98026%27 HTTP/1.1" 200 None
2026-03-28 05:36:01 [auto1.de] INFO: Scrape type for FD98026: 0
2026-03-28 05:36:01 [auto1.de] INFO: Found listing with ID: AT70928
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT70928%27 HTTP/1.1" 200 None
2026-03-28 05:36:01 [auto1.de] INFO: Scrape type for AT70928: 0
2026-03-28 05:36:01 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-28 05:36:01 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-28 05:36:01 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-28 05:36:01 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-28 05:36:01 [auto1.de] INFO: Scrape type for TW44839: 2
2026-03-28 05:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with identifier: TW44839
2026-03-28 05:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with scrape type 2
2026-03-28 05:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with scrape type 2
2026-03-28 05:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8617e3c-1f1a-5b78-8f42-c3daa1790a37, identifier: TW44839
2026-03-28 05:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with identifier: TW44839
2026-03-28 05:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with identifier: TW44839
2026-03-28 05:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with identifier: TW44839 to the API
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:08:29Z',
 'fuel_type': 'diesel',
 'id': 'd8617e3c-1f1a-5b78-8f42-c3daa1790a37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW44839',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 119919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-04',
 'seller_name': None,
 'title': 'BMW 2er 220d Active Tourer xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2015}
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Saving data for TW44839: {'auction_closing_time': 1774714109.0, 'created_time': 1773946476.629335, 'last_price_update_time': 1774676162.146997}
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW44839') HTTP/1.1" 204 0
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: WX26579
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: ZH86268
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH86268%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Scrape type for ZH86268: 0
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Scrape type for AP13896: 2
2026-03-28 05:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 199d7d02-91b6-522d-9977-7d559aabc6bd with identifier: AP13896
2026-03-28 05:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 199d7d02-91b6-522d-9977-7d559aabc6bd with scrape type 2
2026-03-28 05:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 199d7d02-91b6-522d-9977-7d559aabc6bd with scrape type 2
2026-03-28 05:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 199d7d02-91b6-522d-9977-7d559aabc6bd, identifier: AP13896
2026-03-28 05:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 199d7d02-91b6-522d-9977-7d559aabc6bd with identifier: AP13896
2026-03-28 05:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 199d7d02-91b6-522d-9977-7d559aabc6bd with identifier: AP13896
2026-03-28 05:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 199d7d02-91b6-522d-9977-7d559aabc6bd with identifier: AP13896 to the API
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:03:06Z',
 'fuel_type': 'petrol',
 'id': '199d7d02-91b6-522d-9977-7d559aabc6bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP13896',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 140843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2017}
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Saving data for AP13896: {'auction_closing_time': 1774713786.0, 'created_time': 1774553004.246292, 'last_price_update_time': 1774676162.613408}
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP13896') HTTP/1.1" 204 0
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: DR46257
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: EF20977
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF20977%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Scrape type for EF20977: 0
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: XC72019
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: TF67733
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: WC68946
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC68946%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Scrape type for WC68946: 0
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Scrape type for JB95370: 0
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Scrape type for HF35410: 0
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: FA98642
2026-03-28 05:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:03 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: XP88597
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP88597%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for XP88597: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: MC27583
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27583%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for MC27583: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: RJ38519
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: JY58234
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY58234%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for JY58234: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: CA68070
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: TS97270
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: UR35427
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR35427%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for UR35427: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: YY00170
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: YW63189
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU28651%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for FU28651: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: KS68262
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS68262%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for KS68262: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: PC84380
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC84380%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for PC84380: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: DL80467
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: LP13779
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: RB24690
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB24690%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for RB24690: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: JA21059
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: MX11677
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for KU93910: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for JN06918: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: XX85563
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: XE44885
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: PY07137
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07137%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for PY07137: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: JX05743
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10354%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for RT10354: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: WP32637
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP32637%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for WP32637: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: BV43542
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV43542%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for BV43542: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: US71908
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: PU73316
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: BY01569
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY01569%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for BY01569: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: AV44518
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK51417%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for TK51417: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: BG37416
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG37416%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for BG37416: 0
2026-03-28 05:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:04 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV81502%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for BV81502: 0
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: JH74007
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: NN39507
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN39507%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for NN39507: 0
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: LC01777
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC01777%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for LC01777: 0
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: ZV97129
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: VK57644
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK57644%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for VK57644: 0
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: VU62087
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU62087%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for VU62087: 0
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for BP04527: 0
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: ST72008
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST72008%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for ST72008: 0
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: CR84704
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR84704%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for CR84704: 2
2026-03-28 05:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbcd888e-8d9b-507a-94bf-87a9acde1eca with identifier: CR84704
2026-03-28 05:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbcd888e-8d9b-507a-94bf-87a9acde1eca with scrape type 2
2026-03-28 05:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbcd888e-8d9b-507a-94bf-87a9acde1eca with scrape type 2
2026-03-28 05:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbcd888e-8d9b-507a-94bf-87a9acde1eca, identifier: CR84704
2026-03-28 05:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbcd888e-8d9b-507a-94bf-87a9acde1eca with identifier: CR84704
2026-03-28 05:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbcd888e-8d9b-507a-94bf-87a9acde1eca with identifier: CR84704
2026-03-28 05:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbcd888e-8d9b-507a-94bf-87a9acde1eca with identifier: CR84704 to the API
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:12:51Z',
 'fuel_type': 'diesel',
 'id': 'bbcd888e-8d9b-507a-94bf-87a9acde1eca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR84704',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 257145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-23',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR84704%27 HTTP/1.1" 200 None
2026-03-28 05:36:05 [auto1.de] INFO: Saving data for CR84704: {'auction_closing_time': 1774714371.0, 'created_time': 1774551909.309955, 'last_price_update_time': 1774676165.406034}
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR84704') HTTP/1.1" 204 0
2026-03-28 05:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: XU56057
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: FU46952
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-28 05:36:05 [auto1.de] INFO: Scrape type for RK13717: 0
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: HG52162
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG52162%27 HTTP/1.1" 200 None
2026-03-28 05:36:05 [auto1.de] INFO: Scrape type for HG52162: 0
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: XP80923
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP80923%27 HTTP/1.1" 200 None
2026-03-28 05:36:05 [auto1.de] INFO: Scrape type for XP80923: 0
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: TC50609
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC50609%27 HTTP/1.1" 200 None
2026-03-28 05:36:05 [auto1.de] INFO: Scrape type for TC50609: 0
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: SN43229
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: BZ43252
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: TH64703
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH64703%27 HTTP/1.1" 200 None
2026-03-28 05:36:05 [auto1.de] INFO: Scrape type for TH64703: 0
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: AC00549
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: DF79170
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-28 05:36:05 [auto1.de] INFO: Scrape type for FE12352: 2
2026-03-28 05:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352
2026-03-28 05:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with scrape type 2
2026-03-28 05:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with scrape type 2
2026-03-28 05:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d9f5f5d-7d0c-549d-9eab-deb833afc929, identifier: FE12352
2026-03-28 05:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352
2026-03-28 05:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352
2026-03-28 05:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352 to the API
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:50:35Z',
 'fuel_type': 'petrol',
 'id': '1d9f5f5d-7d0c-549d-9eab-deb833afc929',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE12352',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 14854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-23',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Saving data for FE12352: {'auction_closing_time': 1774716635.0, 'created_time': 1774553037.704881, 'last_price_update_time': 1774676166.047095}
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE12352') HTTP/1.1" 204 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: PJ00212
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ00212%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for PJ00212: 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: BP89276
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: BL42626
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL42626%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for BL42626: 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: CE66063
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE66063%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for CE66063: 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for WF56073: 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: BX01019
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: KP49252
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP49252%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for KP49252: 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: BJ62056
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ62056%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for BJ62056: 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: KJ62910
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: YJ35877
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ35877%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for YJ35877: 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: NS67917
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS67917%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for NS67917: 2
2026-03-28 05:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27a0e074-29cb-56c1-ab32-9ddb73c79f6e with identifier: NS67917
2026-03-28 05:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27a0e074-29cb-56c1-ab32-9ddb73c79f6e with scrape type 2
2026-03-28 05:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27a0e074-29cb-56c1-ab32-9ddb73c79f6e with scrape type 2
2026-03-28 05:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27a0e074-29cb-56c1-ab32-9ddb73c79f6e, identifier: NS67917
2026-03-28 05:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27a0e074-29cb-56c1-ab32-9ddb73c79f6e with identifier: NS67917
2026-03-28 05:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27a0e074-29cb-56c1-ab32-9ddb73c79f6e with identifier: NS67917
2026-03-28 05:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27a0e074-29cb-56c1-ab32-9ddb73c79f6e with identifier: NS67917 to the API
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:05:21Z',
 'fuel_type': 'petrol',
 'id': '27a0e074-29cb-56c1-ab32-9ddb73c79f6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS67917',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 64200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS67917%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Saving data for NS67917: {'auction_closing_time': 1774713921.0, 'created_time': 1774464544.860003, 'last_price_update_time': 1774676166.693977}
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS67917') HTTP/1.1" 204 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for CL06528: 2
2026-03-28 05:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528
2026-03-28 05:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with scrape type 2
2026-03-28 05:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with scrape type 2
2026-03-28 05:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 261adc2e-1e99-5a6c-8d56-f9d4e5203628, identifier: CL06528
2026-03-28 05:36:06 [scrapy.extensions.logstats] INFO: Crawled 116 pages (at 16 pages/min), scraped 416 items (at 76 items/min)
2026-03-28 05:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528
2026-03-28 05:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528
2026-03-28 05:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528 to the API
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:47:53Z',
 'fuel_type': 'petrol',
 'id': '261adc2e-1e99-5a6c-8d56-f9d4e5203628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL06528',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 49971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-08',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Passion',
 'transmission': 'manual',
 'trim': 'Passion',
 'year': 2019}
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-28 05:36:07 [auto1.de] INFO: Saving data for CL06528: {'auction_closing_time': 1774716473.0, 'created_time': 1773945708.047113, 'last_price_update_time': 1774676167.234624}
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL06528') HTTP/1.1" 204 0
2026-03-28 05:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:08 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: JU71873
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: PZ79327
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: DD55179
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD55179%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for DD55179: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: BJ16226
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for LG11243: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: CX80626
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX80626%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for CX80626: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: MX24097
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: SP79691
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: LU60211
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU60211%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for LU60211: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: GF01666
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF01666%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for GF01666: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: DL96803
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL96803%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for DL96803: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for BB78660: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: KA83204
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83204%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for KA83204: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: DK56258
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK56258%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for DK56258: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: EH49621
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for SC73852: 2
2026-03-28 05:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with identifier: SC73852
2026-03-28 05:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with scrape type 2
2026-03-28 05:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with scrape type 2
2026-03-28 05:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2, identifier: SC73852
2026-03-28 05:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with identifier: SC73852
2026-03-28 05:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with identifier: SC73852
2026-03-28 05:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with identifier: SC73852 to the API
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:07:20Z',
 'fuel_type': 'petrol',
 'id': '5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC73852',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 123979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-03',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI quattro S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2010}
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Saving data for SC73852: {'auction_closing_time': 1774714040.0, 'created_time': 1774552446.418803, 'last_price_update_time': 1774676168.879356}
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC73852') HTTP/1.1" 204 0
2026-03-28 05:36:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: YT14311
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: JG51855
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for CN22561: 2
2026-03-28 05:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with identifier: CN22561
2026-03-28 05:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with scrape type 2
2026-03-28 05:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with scrape type 2
2026-03-28 05:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9, identifier: CN22561
2026-03-28 05:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with identifier: CN22561
2026-03-28 05:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with identifier: CN22561
2026-03-28 05:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with identifier: CN22561 to the API
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:14:15Z',
 'fuel_type': 'petrol',
 'id': '4a2d07c6-64f5-5513-8fdf-3c5337c86bc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN22561',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT RS',
 'odometer': 69606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-04',
 'seller_name': None,
 'title': 'Audi TT RS 2.5 TFSI quattro Roadster',
 'transmission': 'automatic',
 'trim': 'quattro Roadster',
 'year': 2013}
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Saving data for CN22561: {'auction_closing_time': 1774714455.0, 'created_time': 1773945895.532458, 'last_price_update_time': 1774676169.42013}
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN22561') HTTP/1.1" 204 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: GU42707
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: KE65935
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: BP81382
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81382%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for BP81382: 2
2026-03-28 05:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aba87dbe-d8fa-591f-b0c9-40dedbb2731c with identifier: BP81382
2026-03-28 05:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aba87dbe-d8fa-591f-b0c9-40dedbb2731c with scrape type 2
2026-03-28 05:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aba87dbe-d8fa-591f-b0c9-40dedbb2731c with scrape type 2
2026-03-28 05:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aba87dbe-d8fa-591f-b0c9-40dedbb2731c, identifier: BP81382
2026-03-28 05:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aba87dbe-d8fa-591f-b0c9-40dedbb2731c with identifier: BP81382
2026-03-28 05:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aba87dbe-d8fa-591f-b0c9-40dedbb2731c with identifier: BP81382
2026-03-28 05:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aba87dbe-d8fa-591f-b0c9-40dedbb2731c with identifier: BP81382 to the API
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:30Z',
 'fuel_type': 'diesel',
 'id': 'aba87dbe-d8fa-591f-b0c9-40dedbb2731c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP81382',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 158675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-28',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2017}
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81382%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Saving data for BP81382: {'auction_closing_time': 1774715850.0, 'created_time': 1774468015.064515, 'last_price_update_time': 1774676169.915322}
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP81382') HTTP/1.1" 204 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: CN22310
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22310%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for CN22310: 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: HU80433
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU80433%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for HU80433: 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: MG35847
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG35847%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for MG35847: 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-28 05:36:10 [auto1.de] INFO: Scrape type for FH31570: 2
2026-03-28 05:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with identifier: FH31570
2026-03-28 05:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with scrape type 2
2026-03-28 05:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with scrape type 2
2026-03-28 05:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2664929a-bc55-5ca7-965d-c8a6e3b549a4, identifier: FH31570
2026-03-28 05:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with identifier: FH31570
2026-03-28 05:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with identifier: FH31570
2026-03-28 05:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with identifier: FH31570 to the API
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:04:50Z',
 'fuel_type': 'petrol',
 'id': '2664929a-bc55-5ca7-965d-c8a6e3b549a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH31570',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 107696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Allstar',
 'transmission': 'manual',
 'trim': 'Allstar',
 'year': 2016}
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-28 05:36:10 [auto1.de] INFO: Saving data for FH31570: {'auction_closing_time': 1774713890.0, 'created_time': 1774551191.52656, 'last_price_update_time': 1774676170.457782}
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH31570') HTTP/1.1" 204 0
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: ZB54249
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: AK76136
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK76136%27 HTTP/1.1" 200 None
2026-03-28 05:36:10 [auto1.de] INFO: Scrape type for AK76136: 0
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: SW71463
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-28 05:36:10 [auto1.de] INFO: Scrape type for HT70874: 0
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-28 05:36:10 [auto1.de] INFO: Scrape type for NW77024: 0
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: NU50542
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: EP25363
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: CL49552
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: MP85459
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: JY72572
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY72572%27 HTTP/1.1" 200 None
2026-03-28 05:36:10 [auto1.de] INFO: Scrape type for JY72572: 0
2026-03-28 05:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:14 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:14 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-28 05:36:14 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-28 05:36:14 [auto1.de] INFO: Scrape type for CV73879: 0
2026-03-28 05:36:14 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-28 05:36:14 [auto1.de] INFO: Scrape type for DA23811: 0
2026-03-28 05:36:14 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-28 05:36:14 [auto1.de] INFO: Scrape type for BV96832: 2
2026-03-28 05:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61043bb6-83a5-5517-aca8-e5073aae6ced with identifier: BV96832
2026-03-28 05:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61043bb6-83a5-5517-aca8-e5073aae6ced with scrape type 2
2026-03-28 05:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61043bb6-83a5-5517-aca8-e5073aae6ced with scrape type 2
2026-03-28 05:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61043bb6-83a5-5517-aca8-e5073aae6ced, identifier: BV96832
2026-03-28 05:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61043bb6-83a5-5517-aca8-e5073aae6ced with identifier: BV96832
2026-03-28 05:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61043bb6-83a5-5517-aca8-e5073aae6ced with identifier: BV96832
2026-03-28 05:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61043bb6-83a5-5517-aca8-e5073aae6ced with identifier: BV96832 to the API
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:11:49Z',
 'fuel_type': 'diesel',
 'id': '61043bb6-83a5-5517-aca8-e5073aae6ced',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV96832',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 191657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-22',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 116 CDI Extralang',
 'transmission': 'automatic',
 'trim': 'Extralang',
 'year': 2014}
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Saving data for BV96832: {'auction_closing_time': 1774714309.0, 'created_time': 1774589437.287928, 'last_price_update_time': 1774676175.088838}
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV96832') HTTP/1.1" 204 0
2026-03-28 05:36:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for AH07700: 2
2026-03-28 05:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with identifier: AH07700
2026-03-28 05:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with scrape type 2
2026-03-28 05:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with scrape type 2
2026-03-28 05:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028, identifier: AH07700
2026-03-28 05:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with identifier: AH07700
2026-03-28 05:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with identifier: AH07700
2026-03-28 05:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with identifier: AH07700 to the API
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-28T16:19:18Z',
 'fuel_type': 'petrol',
 'id': '1cd8eb1e-8d34-5dd9-b362-8d9232fa8028',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH07700',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 161201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-26',
 'seller_name': None,
 'title': 'Mazda 6 2.0 Sport Active',
 'transmission': 'manual',
 'trim': 'Sport Active',
 'year': 2007}
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Saving data for AH07700: {'auction_closing_time': 1774714758.0, 'created_time': 1773945715.296506, 'last_price_update_time': 1774676175.597852}
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH07700') HTTP/1.1" 204 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: FJ74023
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ74023%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for FJ74023: 2
2026-03-28 05:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d20fa04-837e-554a-ae92-414e28bf0cc0 with identifier: FJ74023
2026-03-28 05:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d20fa04-837e-554a-ae92-414e28bf0cc0 with scrape type 2
2026-03-28 05:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d20fa04-837e-554a-ae92-414e28bf0cc0 with scrape type 2
2026-03-28 05:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d20fa04-837e-554a-ae92-414e28bf0cc0, identifier: FJ74023
2026-03-28 05:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d20fa04-837e-554a-ae92-414e28bf0cc0 with identifier: FJ74023
2026-03-28 05:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d20fa04-837e-554a-ae92-414e28bf0cc0 with identifier: FJ74023
2026-03-28 05:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d20fa04-837e-554a-ae92-414e28bf0cc0 with identifier: FJ74023 to the API
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:46:11Z',
 'fuel_type': 'petrol',
 'id': '0d20fa04-837e-554a-ae92-414e28bf0cc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ74023',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 43413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-21',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 LS +',
 'transmission': 'manual',
 'trim': 'LS +',
 'year': 2013}
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ74023%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Saving data for FJ74023: {'auction_closing_time': 1774716371.0, 'created_time': 1774467966.757486, 'last_price_update_time': 1774676176.017554}
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ74023') HTTP/1.1" 204 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: NL55322
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL55322%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for NL55322: 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: GC35405
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: XM28055
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: SZ44736
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ44736%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for SZ44736: 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: TE88755
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE88755%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for TE88755: 2
2026-03-28 05:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93d7f208-a4d8-5363-95e6-634d9363cffb with identifier: TE88755
2026-03-28 05:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d7f208-a4d8-5363-95e6-634d9363cffb with scrape type 2
2026-03-28 05:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93d7f208-a4d8-5363-95e6-634d9363cffb with scrape type 2
2026-03-28 05:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93d7f208-a4d8-5363-95e6-634d9363cffb, identifier: TE88755
2026-03-28 05:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93d7f208-a4d8-5363-95e6-634d9363cffb with identifier: TE88755
2026-03-28 05:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93d7f208-a4d8-5363-95e6-634d9363cffb with identifier: TE88755
2026-03-28 05:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93d7f208-a4d8-5363-95e6-634d9363cffb with identifier: TE88755 to the API
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:04:22Z',
 'fuel_type': 'petrol',
 'id': '93d7f208-a4d8-5363-95e6-634d9363cffb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE88755',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 190683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-11-11',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 1997}
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE88755%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Saving data for TE88755: {'auction_closing_time': 1774713862.0, 'created_time': 1774466225.060464, 'last_price_update_time': 1774676176.474757}
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE88755') HTTP/1.1" 204 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: XM44045
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM44045%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for XM44045: 2
2026-03-28 05:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8801e587-afd4-5e0a-9dc5-840ab40d27a7 with identifier: XM44045
2026-03-28 05:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8801e587-afd4-5e0a-9dc5-840ab40d27a7 with scrape type 2
2026-03-28 05:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8801e587-afd4-5e0a-9dc5-840ab40d27a7 with scrape type 2
2026-03-28 05:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8801e587-afd4-5e0a-9dc5-840ab40d27a7, identifier: XM44045
2026-03-28 05:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8801e587-afd4-5e0a-9dc5-840ab40d27a7 with identifier: XM44045
2026-03-28 05:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8801e587-afd4-5e0a-9dc5-840ab40d27a7 with identifier: XM44045
2026-03-28 05:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8801e587-afd4-5e0a-9dc5-840ab40d27a7 with identifier: XM44045 to the API
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:39Z',
 'fuel_type': 'petrol',
 'id': '8801e587-afd4-5e0a-9dc5-840ab40d27a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM44045',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 90910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM44045%27 HTTP/1.1" 200 None
2026-03-28 05:36:17 [auto1.de] INFO: Saving data for XM44045: {'auction_closing_time': 1774714719.0, 'created_time': 1774466228.870357, 'last_price_update_time': 1774676177.888634}
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM44045') HTTP/1.1" 204 0
2026-03-28 05:36:17 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-28 05:36:17 [auto1.de] INFO: Scrape type for RB89503: 0
2026-03-28 05:36:17 [auto1.de] INFO: Found listing with ID: SL38936
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL38936%27 HTTP/1.1" 200 None
2026-03-28 05:36:17 [auto1.de] INFO: Scrape type for SL38936: 0
2026-03-28 05:36:17 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-28 05:36:17 [auto1.de] INFO: Scrape type for XT91085: 0
2026-03-28 05:36:17 [auto1.de] INFO: Found listing with ID: XJ41325
2026-03-28 05:36:17 [auto1.de] INFO: Found listing with ID: ND84220
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND84220%27 HTTP/1.1" 200 None
2026-03-28 05:36:17 [auto1.de] INFO: Scrape type for ND84220: 0
2026-03-28 05:36:17 [auto1.de] INFO: Found listing with ID: SW03993
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW03993%27 HTTP/1.1" 200 None
2026-03-28 05:36:18 [auto1.de] INFO: Scrape type for SW03993: 2
2026-03-28 05:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf954da-88c9-5751-a2d3-caed3a5d1268 with identifier: SW03993
2026-03-28 05:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf954da-88c9-5751-a2d3-caed3a5d1268 with scrape type 2
2026-03-28 05:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cf954da-88c9-5751-a2d3-caed3a5d1268 with scrape type 2
2026-03-28 05:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cf954da-88c9-5751-a2d3-caed3a5d1268, identifier: SW03993
2026-03-28 05:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cf954da-88c9-5751-a2d3-caed3a5d1268 with identifier: SW03993
2026-03-28 05:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cf954da-88c9-5751-a2d3-caed3a5d1268 with identifier: SW03993
2026-03-28 05:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cf954da-88c9-5751-a2d3-caed3a5d1268 with identifier: SW03993 to the API
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:33:50Z',
 'fuel_type': 'diesel',
 'id': '1cf954da-88c9-5751-a2d3-caed3a5d1268',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW03993',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 157913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-05',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Spirit 4WD',
 'transmission': 'automatic',
 'trim': 'Spirit 4WD',
 'year': 2014}
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW03993%27 HTTP/1.1" 200 None
2026-03-28 05:36:18 [auto1.de] INFO: Saving data for SW03993: {'auction_closing_time': 1774715630.0, 'created_time': 1773830451.928013, 'last_price_update_time': 1774676178.417122}
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW03993') HTTP/1.1" 204 0
2026-03-28 05:36:18 [auto1.de] INFO: Found listing with ID: SL19665
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL19665%27 HTTP/1.1" 200 None
2026-03-28 05:36:18 [auto1.de] INFO: Scrape type for SL19665: 2
2026-03-28 05:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d19573a-49c4-527f-9b3e-9ecf90ab99d1 with identifier: SL19665
2026-03-28 05:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d19573a-49c4-527f-9b3e-9ecf90ab99d1 with scrape type 2
2026-03-28 05:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d19573a-49c4-527f-9b3e-9ecf90ab99d1 with scrape type 2
2026-03-28 05:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d19573a-49c4-527f-9b3e-9ecf90ab99d1, identifier: SL19665
2026-03-28 05:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d19573a-49c4-527f-9b3e-9ecf90ab99d1 with identifier: SL19665
2026-03-28 05:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d19573a-49c4-527f-9b3e-9ecf90ab99d1 with identifier: SL19665
2026-03-28 05:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d19573a-49c4-527f-9b3e-9ecf90ab99d1 with identifier: SL19665 to the API
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:15Z',
 'fuel_type': 'diesel',
 'id': '4d19573a-49c4-527f-9b3e-9ecf90ab99d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL19665',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 316314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-03',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL19665%27 HTTP/1.1" 200 None
2026-03-28 05:36:18 [auto1.de] INFO: Saving data for SL19665: {'auction_closing_time': 1774714515.0, 'created_time': 1774503046.117848, 'last_price_update_time': 1774676178.844633}
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL19665') HTTP/1.1" 204 0
2026-03-28 05:36:18 [auto1.de] INFO: Found listing with ID: MT39473
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT39473%27 HTTP/1.1" 200 None
2026-03-28 05:36:18 [auto1.de] INFO: Scrape type for MT39473: 0
2026-03-28 05:36:18 [auto1.de] INFO: Found listing with ID: SV83384
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV83384%27 HTTP/1.1" 200 None
2026-03-28 05:36:18 [auto1.de] INFO: Scrape type for SV83384: 0
2026-03-28 05:36:18 [auto1.de] INFO: Found listing with ID: HN26382
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN26382%27 HTTP/1.1" 200 None
2026-03-28 05:36:18 [auto1.de] INFO: Scrape type for HN26382: 0
2026-03-28 05:36:18 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-28 05:36:18 [auto1.de] INFO: Scrape type for HT62005: 2
2026-03-28 05:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005
2026-03-28 05:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abf96e34-ab6c-55a5-a694-b3c1aa150498 with scrape type 2
2026-03-28 05:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abf96e34-ab6c-55a5-a694-b3c1aa150498 with scrape type 2
2026-03-28 05:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abf96e34-ab6c-55a5-a694-b3c1aa150498, identifier: HT62005
2026-03-28 05:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005
2026-03-28 05:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005
2026-03-28 05:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005 to the API
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:47Z',
 'fuel_type': 'diesel',
 'id': 'abf96e34-ab6c-55a5-a694-b3c1aa150498',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT62005',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 88085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-23',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport D150 S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2020}
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Saving data for HT62005: {'auction_closing_time': 1774716767.0, 'created_time': 1774550647.246186, 'last_price_update_time': 1774676179.349633}
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT62005') HTTP/1.1" 204 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: AL74517
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL74517%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for AL74517: 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: RJ03862
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ03862%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for RJ03862: 2
2026-03-28 05:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef8f0f30-2e77-5151-b457-57ef9a0b0754 with identifier: RJ03862
2026-03-28 05:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef8f0f30-2e77-5151-b457-57ef9a0b0754 with scrape type 2
2026-03-28 05:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef8f0f30-2e77-5151-b457-57ef9a0b0754 with scrape type 2
2026-03-28 05:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef8f0f30-2e77-5151-b457-57ef9a0b0754, identifier: RJ03862
2026-03-28 05:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef8f0f30-2e77-5151-b457-57ef9a0b0754 with identifier: RJ03862
2026-03-28 05:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef8f0f30-2e77-5151-b457-57ef9a0b0754 with identifier: RJ03862
2026-03-28 05:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef8f0f30-2e77-5151-b457-57ef9a0b0754 with identifier: RJ03862 to the API
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:09:13Z',
 'fuel_type': 'diesel',
 'id': 'ef8f0f30-2e77-5151-b457-57ef9a0b0754',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ03862',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 146033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-11',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 CDI Special Edition Avantgarde',
 'transmission': 'manual',
 'trim': 'Special Edition Avantgarde',
 'year': 2009}
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ03862%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Saving data for RJ03862: {'auction_closing_time': 1774714153.0, 'created_time': 1773132491.335794, 'last_price_update_time': 1774676179.897477}
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ03862') HTTP/1.1" 204 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: RB22775
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB22775%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for RB22775: 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for VS05622: 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: DF48310
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF48310%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for DF48310: 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: YY19012
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY19012%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for YY19012: 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for BG13835: 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: AB33949
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB33949%27 HTTP/1.1" 200 None
2026-03-28 05:36:20 [auto1.de] INFO: Scrape type for AB33949: 0
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: NS90051
2026-03-28 05:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:20 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: BR94807
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: SD77911
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD77911%27 HTTP/1.1" 200 None
2026-03-28 05:36:20 [auto1.de] INFO: Scrape type for SD77911: 0
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: HK07166
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK07166%27 HTTP/1.1" 200 None
2026-03-28 05:36:20 [auto1.de] INFO: Scrape type for HK07166: 0
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: AE50962
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE50962%27 HTTP/1.1" 200 None
2026-03-28 05:36:20 [auto1.de] INFO: Scrape type for AE50962: 0
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: PA10623
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10623%27 HTTP/1.1" 200 None
2026-03-28 05:36:20 [auto1.de] INFO: Scrape type for PA10623: 0
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: NP12620
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP12620%27 HTTP/1.1" 200 None
2026-03-28 05:36:20 [auto1.de] INFO: Scrape type for NP12620: 0
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: NA24630
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: VC66912
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC66912%27 HTTP/1.1" 200 None
2026-03-28 05:36:20 [auto1.de] INFO: Scrape type for VC66912: 0
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: TD00729
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD00729%27 HTTP/1.1" 200 None
2026-03-28 05:36:20 [auto1.de] INFO: Scrape type for TD00729: 0
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: FZ35057
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: PP58013
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: GG43285
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: RX33159
2026-03-28 05:36:20 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-28 05:36:20 [auto1.de] INFO: Scrape type for XP95900: 2
2026-03-28 05:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with identifier: XP95900
2026-03-28 05:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with scrape type 2
2026-03-28 05:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with scrape type 2
2026-03-28 05:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d247e7-0d6b-5b25-ad99-eab54a1f5825, identifier: XP95900
2026-03-28 05:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with identifier: XP95900
2026-03-28 05:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with identifier: XP95900
2026-03-28 05:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with identifier: XP95900 to the API
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:07:27Z',
 'fuel_type': 'petrol',
 'id': 'c4d247e7-0d6b-5b25-ad99-eab54a1f5825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP95900',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 183328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-28',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-28 05:36:21 [auto1.de] INFO: Saving data for XP95900: {'auction_closing_time': 1774714047.0, 'created_time': 1773917351.096327, 'last_price_update_time': 1774676181.410715}
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP95900') HTTP/1.1" 204 0
2026-03-28 05:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: PN00069
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-28 05:36:21 [auto1.de] INFO: Scrape type for RA28686: 0
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: JN73492
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: UY94475
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: HY42291
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: WP34180
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: MH83701
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH83701%27 HTTP/1.1" 200 None
2026-03-28 05:36:21 [auto1.de] INFO: Scrape type for MH83701: 2
2026-03-28 05:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a94e52f-3d8c-5538-a000-24302b4e5c34 with identifier: MH83701
2026-03-28 05:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a94e52f-3d8c-5538-a000-24302b4e5c34 with scrape type 2
2026-03-28 05:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a94e52f-3d8c-5538-a000-24302b4e5c34 with scrape type 2
2026-03-28 05:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a94e52f-3d8c-5538-a000-24302b4e5c34, identifier: MH83701
2026-03-28 05:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a94e52f-3d8c-5538-a000-24302b4e5c34 with identifier: MH83701
2026-03-28 05:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a94e52f-3d8c-5538-a000-24302b4e5c34 with identifier: MH83701
2026-03-28 05:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a94e52f-3d8c-5538-a000-24302b4e5c34 with identifier: MH83701 to the API
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:58:23Z',
 'fuel_type': 'petrol',
 'id': '9a94e52f-3d8c-5538-a000-24302b4e5c34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH83701',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 129954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-23',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2017}
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH83701%27 HTTP/1.1" 200 None
2026-03-28 05:36:21 [auto1.de] INFO: Saving data for MH83701: {'auction_closing_time': 1774717103.0, 'created_time': 1774552634.25266, 'last_price_update_time': 1774676181.990123}
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH83701') HTTP/1.1" 204 0
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: VV35876
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ73657%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Scrape type for WJ73657: 0
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: EH05548
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Scrape type for ZG14470: 2
2026-03-28 05:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25a75274-8b57-59ea-905a-a0c07779c83f with identifier: ZG14470
2026-03-28 05:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25a75274-8b57-59ea-905a-a0c07779c83f with scrape type 2
2026-03-28 05:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25a75274-8b57-59ea-905a-a0c07779c83f with scrape type 2
2026-03-28 05:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25a75274-8b57-59ea-905a-a0c07779c83f, identifier: ZG14470
2026-03-28 05:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25a75274-8b57-59ea-905a-a0c07779c83f with identifier: ZG14470
2026-03-28 05:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25a75274-8b57-59ea-905a-a0c07779c83f with identifier: ZG14470
2026-03-28 05:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25a75274-8b57-59ea-905a-a0c07779c83f with identifier: ZG14470 to the API
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:33Z',
 'fuel_type': 'diesel',
 'id': '25a75274-8b57-59ea-905a-a0c07779c83f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG14470',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 197615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI kompakt Trend',
 'transmission': 'manual',
 'trim': 'kompakt Trend',
 'year': 2006}
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Saving data for ZG14470: {'auction_closing_time': 1774715193.0, 'created_time': 1773945209.792634, 'last_price_update_time': 1774676182.472304}
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG14470') HTTP/1.1" 204 0
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: UA33739
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: VN96863
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN96863%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Scrape type for VN96863: 0
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: AN16579
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN16579%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Scrape type for AN16579: 0
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: FX77489
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Scrape type for BL86865: 0
2026-03-28 05:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:23 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-28 05:36:23 [auto1.de] INFO: Scrape type for MC04391: 0
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: FK23500
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: HR99158
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR99158%27 HTTP/1.1" 200 None
2026-03-28 05:36:23 [auto1.de] INFO: Scrape type for HR99158: 2
2026-03-28 05:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 816dcedd-33ff-5786-87b1-6dbe878977e4 with identifier: HR99158
2026-03-28 05:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 816dcedd-33ff-5786-87b1-6dbe878977e4 with scrape type 2
2026-03-28 05:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 816dcedd-33ff-5786-87b1-6dbe878977e4 with scrape type 2
2026-03-28 05:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 816dcedd-33ff-5786-87b1-6dbe878977e4, identifier: HR99158
2026-03-28 05:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 816dcedd-33ff-5786-87b1-6dbe878977e4 with identifier: HR99158
2026-03-28 05:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 816dcedd-33ff-5786-87b1-6dbe878977e4 with identifier: HR99158
2026-03-28 05:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 816dcedd-33ff-5786-87b1-6dbe878977e4 with identifier: HR99158 to the API
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:28Z',
 'fuel_type': 'diesel',
 'id': '816dcedd-33ff-5786-87b1-6dbe878977e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR99158',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 167949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-11',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR99158%27 HTTP/1.1" 200 None
2026-03-28 05:36:24 [auto1.de] INFO: Saving data for HR99158: {'auction_closing_time': 1774714768.0, 'created_time': 1774467356.518624, 'last_price_update_time': 1774676184.409152}
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR99158') HTTP/1.1" 204 0
2026-03-28 05:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:24 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-28 05:36:24 [auto1.de] INFO: Found listing with ID: WJ35456
2026-03-28 05:36:24 [auto1.de] INFO: Found listing with ID: XS00144
2026-03-28 05:36:24 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-28 05:36:24 [auto1.de] INFO: Scrape type for UN73859: 2
2026-03-28 05:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859
2026-03-28 05:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a426c313-2e75-5a1b-8f7d-c6468b298c26 with scrape type 2
2026-03-28 05:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a426c313-2e75-5a1b-8f7d-c6468b298c26 with scrape type 2
2026-03-28 05:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a426c313-2e75-5a1b-8f7d-c6468b298c26, identifier: UN73859
2026-03-28 05:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859
2026-03-28 05:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859
2026-03-28 05:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859 to the API
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:21Z',
 'fuel_type': 'petrol',
 'id': 'a426c313-2e75-5a1b-8f7d-c6468b298c26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN73859',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 53357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-27',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-28 05:36:24 [auto1.de] INFO: Saving data for UN73859: {'auction_closing_time': 1774715481.0, 'created_time': 1773226787.943211, 'last_price_update_time': 1774676184.908832}
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN73859') HTTP/1.1" 204 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: AT81603
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT81603%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for AT81603: 2
2026-03-28 05:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaa2599e-3dbd-51db-8b5f-d8e0c4d60516 with identifier: AT81603
2026-03-28 05:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaa2599e-3dbd-51db-8b5f-d8e0c4d60516 with scrape type 2
2026-03-28 05:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaa2599e-3dbd-51db-8b5f-d8e0c4d60516 with scrape type 2
2026-03-28 05:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aaa2599e-3dbd-51db-8b5f-d8e0c4d60516, identifier: AT81603
2026-03-28 05:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aaa2599e-3dbd-51db-8b5f-d8e0c4d60516 with identifier: AT81603
2026-03-28 05:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aaa2599e-3dbd-51db-8b5f-d8e0c4d60516 with identifier: AT81603
2026-03-28 05:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aaa2599e-3dbd-51db-8b5f-d8e0c4d60516 with identifier: AT81603 to the API
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:55:33Z',
 'fuel_type': 'petrol',
 'id': 'aaa2599e-3dbd-51db-8b5f-d8e0c4d60516',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT81603',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 34773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-16',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT81603%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Saving data for AT81603: {'auction_closing_time': 1774716933.0, 'created_time': 1774463619.425889, 'last_price_update_time': 1774676185.55528}
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT81603') HTTP/1.1" 204 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: EX72075
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72075%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for EX72075: 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: FV97626
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: RB55254
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB55254%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for RB55254: 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: LT89703
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: FC82550
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF75644%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for MF75644: 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: PF15071
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF15071%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for PF15071: 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: RL59137
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: WG72441
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG72441%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for WG72441: 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: AZ18369
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ18369%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for AZ18369: 2
2026-03-28 05:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9794feee-50c3-516e-ac9a-73305e727b9c with identifier: AZ18369
2026-03-28 05:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9794feee-50c3-516e-ac9a-73305e727b9c with scrape type 2
2026-03-28 05:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9794feee-50c3-516e-ac9a-73305e727b9c with scrape type 2
2026-03-28 05:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9794feee-50c3-516e-ac9a-73305e727b9c, identifier: AZ18369
2026-03-28 05:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9794feee-50c3-516e-ac9a-73305e727b9c with identifier: AZ18369
2026-03-28 05:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9794feee-50c3-516e-ac9a-73305e727b9c with identifier: AZ18369
2026-03-28 05:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9794feee-50c3-516e-ac9a-73305e727b9c with identifier: AZ18369 to the API
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:07:53Z',
 'fuel_type': 'diesel',
 'id': '9794feee-50c3-516e-ac9a-73305e727b9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ18369',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 246048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-20',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2004}
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ18369%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Saving data for AZ18369: {'auction_closing_time': 1774714073.0, 'created_time': 1774467997.689684, 'last_price_update_time': 1774676186.083061}
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ18369') HTTP/1.1" 204 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for LC91411: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: MJ34390
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for ZJ64916: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: LC00841
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: WX56329
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX56329%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for WX56329: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN56098%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for CN56098: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: DS97225
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for MK09620: 2
2026-03-28 05:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2286d723-cbbf-534a-a0a2-66ca006b57e9 with identifier: MK09620
2026-03-28 05:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2286d723-cbbf-534a-a0a2-66ca006b57e9 with scrape type 2
2026-03-28 05:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2286d723-cbbf-534a-a0a2-66ca006b57e9 with scrape type 2
2026-03-28 05:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2286d723-cbbf-534a-a0a2-66ca006b57e9, identifier: MK09620
2026-03-28 05:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2286d723-cbbf-534a-a0a2-66ca006b57e9 with identifier: MK09620
2026-03-28 05:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2286d723-cbbf-534a-a0a2-66ca006b57e9 with identifier: MK09620
2026-03-28 05:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2286d723-cbbf-534a-a0a2-66ca006b57e9 with identifier: MK09620 to the API
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:14:49Z',
 'fuel_type': 'petrol',
 'id': '2286d723-cbbf-534a-a0a2-66ca006b57e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK09620',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 30401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seller_name': None,
 'title': 'MINI Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2021}
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Saving data for MK09620: {'auction_closing_time': 1774714489.0, 'created_time': 1774552658.119792, 'last_price_update_time': 1774676186.686912}
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK09620') HTTP/1.1" 204 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: MH41234
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: AG42574
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: WA53567
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA53567%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for WA53567: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: VV73959
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV73959%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for VV73959: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: SF44435
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: YA96951
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96951%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for YA96951: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: NC35073
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: VU78858
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: CB59188
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: CM96643
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for GE16975: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: TY15640
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY15640%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for TY15640: 0
2026-03-28 05:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:27 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: GX49972
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: KS96797
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS96797%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for KS96797: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: SM55936
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM55936%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for SM55936: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: DD53059
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD53059%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for DD53059: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: LU87387
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU87387%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for LU87387: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: SZ17598
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ17598%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for SZ17598: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: GG45079
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG45079%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for GG45079: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: HB99974
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB99974%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for HB99974: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: YZ97980
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: ZA48754
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA48754%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for ZA48754: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: RM29810
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA13082%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for GA13082: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: NM38216
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM38216%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for NM38216: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: TN52823
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: FH96221
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH96221%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for FH96221: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: FP09706
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for BX89684: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: PR94578
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR94578%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for PR94578: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: ZL92656
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: BU43780
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: ZF95436
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: HA51828
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: XG30345
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG30345%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for XG30345: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for HZ88582: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: FU29897
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU29897%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for FU29897: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: HR47989
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR47989%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for HR47989: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for HS83117: 0
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for VS10261: 2
2026-03-28 05:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261
2026-03-28 05:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be2c9a3-e875-5258-ae8c-68e48784f7ed with scrape type 2
2026-03-28 05:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be2c9a3-e875-5258-ae8c-68e48784f7ed with scrape type 2
2026-03-28 05:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9be2c9a3-e875-5258-ae8c-68e48784f7ed, identifier: VS10261
2026-03-28 05:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261
2026-03-28 05:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261
2026-03-28 05:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261 to the API
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:29:24Z',
 'fuel_type': 'petrol',
 'id': '9be2c9a3-e875-5258-ae8c-68e48784f7ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS10261',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 27944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-26',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2019}
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Saving data for VS10261: {'auction_closing_time': 1774715364.0, 'created_time': 1774552847.417718, 'last_price_update_time': 1774676188.103426}
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS10261') HTTP/1.1" 204 0
2026-03-28 05:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: AH42647
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: WP00727
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP00727%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Scrape type for WP00727: 0
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: FH96122
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: RC73620
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: KW02770
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW02770%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Scrape type for KW02770: 0
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: YH14948
2026-03-28 05:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:29 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: YY11140
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY11140%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for YY11140: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: SY24934
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY24934%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for SY24934: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: PD00491
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00491%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for PD00491: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: RE68011
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE68011%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for RE68011: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for RY72669: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: HS45664
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS45664%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for HS45664: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: GA97720
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: LC36947
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: VT05900
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05900%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for VT05900: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: AK10320
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: PG33349
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG33349%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for PG33349: 2
2026-03-28 05:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8ac2cd9-8270-5d66-b1ab-4d3cf3acd662 with identifier: PG33349
2026-03-28 05:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8ac2cd9-8270-5d66-b1ab-4d3cf3acd662 with scrape type 2
2026-03-28 05:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8ac2cd9-8270-5d66-b1ab-4d3cf3acd662 with scrape type 2
2026-03-28 05:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8ac2cd9-8270-5d66-b1ab-4d3cf3acd662, identifier: PG33349
2026-03-28 05:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8ac2cd9-8270-5d66-b1ab-4d3cf3acd662 with identifier: PG33349
2026-03-28 05:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8ac2cd9-8270-5d66-b1ab-4d3cf3acd662 with identifier: PG33349
2026-03-28 05:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8ac2cd9-8270-5d66-b1ab-4d3cf3acd662 with identifier: PG33349 to the API
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:45:38Z',
 'fuel_type': 'petrol',
 'id': 'a8ac2cd9-8270-5d66-b1ab-4d3cf3acd662',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG33349',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 84703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-06',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2019}
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG33349%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Saving data for PG33349: {'auction_closing_time': 1774716338.0, 'created_time': 1773657698.025535, 'last_price_update_time': 1774676189.979812}
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG33349') HTTP/1.1" 204 0
2026-03-28 05:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: AZ88481
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: UJ65232
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: DK90123
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90123%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Scrape type for DK90123: 0
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: DV48088
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: AZ12624
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ12624%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Scrape type for AZ12624: 0
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: MT86254
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT86254%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Scrape type for MT86254: 0
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Scrape type for SR63884: 2
2026-03-28 05:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07043673-6e2f-5c93-82b3-417ca0e3cd73 with identifier: SR63884
2026-03-28 05:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07043673-6e2f-5c93-82b3-417ca0e3cd73 with scrape type 2
2026-03-28 05:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07043673-6e2f-5c93-82b3-417ca0e3cd73 with scrape type 2
2026-03-28 05:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07043673-6e2f-5c93-82b3-417ca0e3cd73, identifier: SR63884
2026-03-28 05:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07043673-6e2f-5c93-82b3-417ca0e3cd73 with identifier: SR63884
2026-03-28 05:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07043673-6e2f-5c93-82b3-417ca0e3cd73 with identifier: SR63884
2026-03-28 05:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07043673-6e2f-5c93-82b3-417ca0e3cd73 with identifier: SR63884 to the API
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:36Z',
 'fuel_type': 'petrol',
 'id': '07043673-6e2f-5c93-82b3-417ca0e3cd73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR63884',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 224687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-05',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun 4Motion',
 'transmission': 'manual',
 'trim': 'Trend & Fun 4Motion',
 'year': 2008}
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Saving data for SR63884: {'auction_closing_time': 1774714536.0, 'created_time': 1774552622.827031, 'last_price_update_time': 1774676190.590858}
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR63884') HTTP/1.1" 204 0
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: NW61921
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: YP60462
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: XW72193
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: FP18966
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: CS08298
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: RT60437
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: SS72230
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: AW71127
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: BN04520
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: SR89713
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR89713%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Scrape type for SR89713: 0
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Scrape type for FZ71323: 0
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: KH76596
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: MT34659
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT34659%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Scrape type for MT34659: 0
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: KW21361
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW21361%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Scrape type for KW21361: 0
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: CP67844
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP67844%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Scrape type for CP67844: 0
2026-03-28 05:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:32 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: TS77277
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS77277%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for TS77277: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for JS09258: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: EE13934
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for AR62221: 2
2026-03-28 05:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221
2026-03-28 05:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with scrape type 2
2026-03-28 05:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with scrape type 2
2026-03-28 05:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52880e4b-6cad-5a97-b17e-99a4cc2755c5, identifier: AR62221
2026-03-28 05:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221
2026-03-28 05:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221
2026-03-28 05:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221 to the API
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:45:54Z',
 'fuel_type': 'petrol',
 'id': '52880e4b-6cad-5a97-b17e-99a4cc2755c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR62221',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 174740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-28',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Saving data for AR62221: {'auction_closing_time': 1774716354.0, 'created_time': 1774552431.811963, 'last_price_update_time': 1774676192.52272}
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR62221') HTTP/1.1" 204 0
2026-03-28 05:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: TE34583
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: KA96977
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA96977%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for KA96977: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: LW41921
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW41921%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for LW41921: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for RZ48384: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: PV97314
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97314%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for PV97314: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for TW01944: 2
2026-03-28 05:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944
2026-03-28 05:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84fb66c5-e426-5269-adf5-0b07651470df with scrape type 2
2026-03-28 05:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84fb66c5-e426-5269-adf5-0b07651470df with scrape type 2
2026-03-28 05:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84fb66c5-e426-5269-adf5-0b07651470df, identifier: TW01944
2026-03-28 05:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944
2026-03-28 05:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944
2026-03-28 05:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944 to the API
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:17:09Z',
 'fuel_type': 'diesel',
 'id': '84fb66c5-e426-5269-adf5-0b07651470df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW01944',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 183706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-23',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Saving data for TW01944: {'auction_closing_time': 1774714629.0, 'created_time': 1773136385.76575, 'last_price_update_time': 1774676193.194907}
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW01944') HTTP/1.1" 204 0
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for ZW06761: 2
2026-03-28 05:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761
2026-03-28 05:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7889c2a0-81fd-5255-818c-e6b29011217a with scrape type 2
2026-03-28 05:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7889c2a0-81fd-5255-818c-e6b29011217a with scrape type 2
2026-03-28 05:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7889c2a0-81fd-5255-818c-e6b29011217a, identifier: ZW06761
2026-03-28 05:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761
2026-03-28 05:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761
2026-03-28 05:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761 to the API
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:54:35Z',
 'fuel_type': 'diesel',
 'id': '7889c2a0-81fd-5255-818c-e6b29011217a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW06761',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 242856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-03',
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM 10 SX L1H1 120 Multijet',
 'transmission': 'manual',
 'trim': '10 SX L1H1 120 Multijet',
 'year': 2010}
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Saving data for ZW06761: {'auction_closing_time': 1774716875.0, 'created_time': 1774552694.371132, 'last_price_update_time': 1774676193.622029}
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW06761') HTTP/1.1" 204 0
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: FN32159
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN32159%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for FN32159: 0
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for MK32752: 0
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: AU19422
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU19422%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for AU19422: 0
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF43262%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for JF43262: 0
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: YC48203
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: XH77572
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: FT62764
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: ZJ19355
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19355%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for ZJ19355: 0
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: YL64188
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL64188%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for YL64188: 2
2026-03-28 05:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c2404e3-5ab3-5197-81b6-017bf0df8d60 with identifier: YL64188
2026-03-28 05:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c2404e3-5ab3-5197-81b6-017bf0df8d60 with scrape type 2
2026-03-28 05:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c2404e3-5ab3-5197-81b6-017bf0df8d60 with scrape type 2
2026-03-28 05:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c2404e3-5ab3-5197-81b6-017bf0df8d60, identifier: YL64188
2026-03-28 05:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c2404e3-5ab3-5197-81b6-017bf0df8d60 with identifier: YL64188
2026-03-28 05:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c2404e3-5ab3-5197-81b6-017bf0df8d60 with identifier: YL64188
2026-03-28 05:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c2404e3-5ab3-5197-81b6-017bf0df8d60 with identifier: YL64188 to the API
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:06:45Z',
 'fuel_type': 'diesel',
 'id': '8c2404e3-5ab3-5197-81b6-017bf0df8d60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL64188',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 115991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-31',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2015}
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL64188%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Saving data for YL64188: {'auction_closing_time': 1774714005.0, 'created_time': 1773224726.605674, 'last_price_update_time': 1774676194.191521}
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL64188') HTTP/1.1" 204 0
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: MY02609
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: VN84329
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN84329%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Scrape type for VN84329: 0
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: SK50734
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK50734%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Scrape type for SK50734: 0
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Scrape type for JN34969: 2
2026-03-28 05:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969
2026-03-28 05:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feff33d0-db5a-5395-b461-d90baf06da5e with scrape type 2
2026-03-28 05:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feff33d0-db5a-5395-b461-d90baf06da5e with scrape type 2
2026-03-28 05:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: feff33d0-db5a-5395-b461-d90baf06da5e, identifier: JN34969
2026-03-28 05:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969
2026-03-28 05:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969
2026-03-28 05:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969 to the API
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:50:08Z',
 'fuel_type': 'diesel',
 'id': 'feff33d0-db5a-5395-b461-d90baf06da5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN34969',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 213374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-22',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Saving data for JN34969: {'auction_closing_time': 1774716608.0, 'created_time': 1774550446.412514, 'last_price_update_time': 1774676194.771224}
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN34969') HTTP/1.1" 204 0
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: CY63402
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: FG94597
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: ZP94489
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP94489%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Scrape type for ZP94489: 0
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: ZA82143
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82143%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Scrape type for ZA82143: 2
2026-03-28 05:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e575faf5-cfbc-5791-8161-7df957296bce with identifier: ZA82143
2026-03-28 05:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e575faf5-cfbc-5791-8161-7df957296bce with scrape type 2
2026-03-28 05:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e575faf5-cfbc-5791-8161-7df957296bce with scrape type 2
2026-03-28 05:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e575faf5-cfbc-5791-8161-7df957296bce, identifier: ZA82143
2026-03-28 05:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e575faf5-cfbc-5791-8161-7df957296bce with identifier: ZA82143
2026-03-28 05:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e575faf5-cfbc-5791-8161-7df957296bce with identifier: ZA82143
2026-03-28 05:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e575faf5-cfbc-5791-8161-7df957296bce with identifier: ZA82143 to the API
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:18:07Z',
 'fuel_type': 'petrol',
 'id': 'e575faf5-cfbc-5791-8161-7df957296bce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA82143',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 126960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-14',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82143%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Saving data for ZA82143: {'auction_closing_time': 1774714687.0, 'created_time': 1774463666.350151, 'last_price_update_time': 1774676195.229448}
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA82143') HTTP/1.1" 204 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: CY68154
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: FL38962
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: EK46666
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: DZ51927
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ51927%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for DZ51927: 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for HW81308: 2
2026-03-28 05:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308
2026-03-28 05:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with scrape type 2
2026-03-28 05:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with scrape type 2
2026-03-28 05:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2, identifier: HW81308
2026-03-28 05:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308
2026-03-28 05:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308
2026-03-28 05:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308 to the API
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:40:03Z',
 'fuel_type': 'diesel',
 'id': '2e0e4d35-ff94-585f-9cf7-db4ab8340fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW81308',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 168377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-16',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Saving data for HW81308: {'auction_closing_time': 1774716003.0, 'created_time': 1773945909.447446, 'last_price_update_time': 1774676195.678199}
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW81308') HTTP/1.1" 204 0
2026-03-28 05:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:35 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: RA23936
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA23936%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for RA23936: 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: RU45291
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: ZT67074
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for CA27289: 2
2026-03-28 05:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289
2026-03-28 05:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743eaa40-a042-5c85-8147-f1fd9798a2ef with scrape type 2
2026-03-28 05:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 743eaa40-a042-5c85-8147-f1fd9798a2ef with scrape type 2
2026-03-28 05:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 743eaa40-a042-5c85-8147-f1fd9798a2ef, identifier: CA27289
2026-03-28 05:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289
2026-03-28 05:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289
2026-03-28 05:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289 to the API
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:32:55Z',
 'fuel_type': 'petrol',
 'id': '743eaa40-a042-5c85-8147-f1fd9798a2ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA27289',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 100623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-02',
 'seller_name': None,
 'title': 'Hyundai i30 1.0 TGDI Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2018}
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Saving data for CA27289: {'auction_closing_time': 1774715575.0, 'created_time': 1774552109.659611, 'last_price_update_time': 1774676196.3485}
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA27289') HTTP/1.1" 204 0
2026-03-28 05:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: XA59462
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59462%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for XA59462: 0
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: UM65045
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM65045%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for UM65045: 0
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for HE80125: 0
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: YY27100
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY27100%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for YY27100: 0
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: XP12912
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: KZ11902
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11902%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for KZ11902: 0
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: KK88346
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: XG53445
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG53445%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for XG53445: 0
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: XP11073
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: ZN09383
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: VX77411
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: FG17963
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG17963%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for FG17963: 0
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: CZ50772
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ50772%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for CZ50772: 0
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: MA82024
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA82024%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for MA82024: 0
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for UX47002: 2
2026-03-28 05:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 827f7340-56cf-5d45-9733-eec472918284 with identifier: UX47002
2026-03-28 05:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827f7340-56cf-5d45-9733-eec472918284 with scrape type 2
2026-03-28 05:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 827f7340-56cf-5d45-9733-eec472918284 with scrape type 2
2026-03-28 05:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 827f7340-56cf-5d45-9733-eec472918284, identifier: UX47002
2026-03-28 05:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 827f7340-56cf-5d45-9733-eec472918284 with identifier: UX47002
2026-03-28 05:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 827f7340-56cf-5d45-9733-eec472918284 with identifier: UX47002
2026-03-28 05:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 827f7340-56cf-5d45-9733-eec472918284 with identifier: UX47002 to the API
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:12:29Z',
 'fuel_type': 'petrol',
 'id': '827f7340-56cf-5d45-9733-eec472918284',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX47002',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 159862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Suzuki Jimny 1.3 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2016}
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Saving data for UX47002: {'auction_closing_time': 1774714349.0, 'created_time': 1774550645.788911, 'last_price_update_time': 1774676196.931626}
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX47002') HTTP/1.1" 204 0
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Scrape type for RN81514: 0
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: ZS98527
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: LX19863
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX19863%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Scrape type for LX19863: 0
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: TX92372
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92372%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Scrape type for TX92372: 0
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: SH68668
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH68668%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Scrape type for SH68668: 0
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: EN47002
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: LV09393
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV09393%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Scrape type for LV09393: 0
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: RE90038
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: DB61618
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB61618%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Scrape type for DB61618: 0
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: FD50641
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD50641%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Scrape type for FD50641: 0
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: FJ00184
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ00184%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Scrape type for FJ00184: 0
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: PC66618
2026-03-28 05:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:38 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: VP49829
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP49829%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for VP49829: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK44731%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for PK44731: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: VP79611
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: LR43035
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: JZ88133
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: ZB28652
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for FK93420: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: HL11639
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: GZ60410
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ60410%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for GZ60410: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: SS89558
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: VA48219
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: NA97113
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA97113%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for NA97113: 2
2026-03-28 05:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 118038d6-fad1-5e61-b07b-fe16c5c7e675 with identifier: NA97113
2026-03-28 05:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 118038d6-fad1-5e61-b07b-fe16c5c7e675 with scrape type 2
2026-03-28 05:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 118038d6-fad1-5e61-b07b-fe16c5c7e675 with scrape type 2
2026-03-28 05:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 118038d6-fad1-5e61-b07b-fe16c5c7e675, identifier: NA97113
2026-03-28 05:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 118038d6-fad1-5e61-b07b-fe16c5c7e675 with identifier: NA97113
2026-03-28 05:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 118038d6-fad1-5e61-b07b-fe16c5c7e675 with identifier: NA97113
2026-03-28 05:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 118038d6-fad1-5e61-b07b-fe16c5c7e675 with identifier: NA97113 to the API
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:43:20Z',
 'fuel_type': 'diesel',
 'id': '118038d6-fad1-5e61-b07b-fe16c5c7e675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA97113',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 243525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'Honda CR-V 1.6 DTEC Elegance 4WD',
 'transmission': 'automatic',
 'trim': 'Elegance 4WD',
 'year': 2016}
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA97113%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Saving data for NA97113: {'auction_closing_time': 1774716200.0, 'created_time': 1774466674.7575, 'last_price_update_time': 1774676198.658259}
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA97113') HTTP/1.1" 204 0
2026-03-28 05:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: KU60138
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU60138%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for KU60138: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: LP87124
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP87124%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for LP87124: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: MH16852
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for NJ99986: 2
2026-03-28 05:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986
2026-03-28 05:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b88148ba-1898-5d41-99ee-1a21693766b2 with scrape type 2
2026-03-28 05:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b88148ba-1898-5d41-99ee-1a21693766b2 with scrape type 2
2026-03-28 05:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b88148ba-1898-5d41-99ee-1a21693766b2, identifier: NJ99986
2026-03-28 05:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986
2026-03-28 05:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986
2026-03-28 05:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986 to the API
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:41:45Z',
 'fuel_type': 'petrol',
 'id': 'b88148ba-1898-5d41-99ee-1a21693766b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ99986',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 43974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-28 05:36:39 [auto1.de] INFO: Saving data for NJ99986: {'auction_closing_time': 1774716105.0, 'created_time': 1774550451.941016, 'last_price_update_time': 1774676199.202693}
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ99986') HTTP/1.1" 204 0
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: HS66299
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: XH30445
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: PM30121
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM30121%27 HTTP/1.1" 200 None
2026-03-28 05:36:39 [auto1.de] INFO: Scrape type for PM30121: 0
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: CU41994
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU41994%27 HTTP/1.1" 200 None
2026-03-28 05:36:39 [auto1.de] INFO: Scrape type for CU41994: 0
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: ZZ39888
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: DP83508
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: AJ12624
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ12624%27 HTTP/1.1" 200 None
2026-03-28 05:36:39 [auto1.de] INFO: Scrape type for AJ12624: 0
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: EU54911
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU54911%27 HTTP/1.1" 200 None
2026-03-28 05:36:39 [auto1.de] INFO: Scrape type for EU54911: 0
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: JE14755
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: XN43654
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: RU00171
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: FB69161
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: XB90815
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: GC12583
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC12583%27 HTTP/1.1" 200 None
2026-03-28 05:36:39 [auto1.de] INFO: Scrape type for GC12583: 0
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: CM42971
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42971%27 HTTP/1.1" 200 None
2026-03-28 05:36:39 [auto1.de] INFO: Scrape type for CM42971: 0
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-28 05:36:39 [auto1.de] INFO: Scrape type for FG94497: 2
2026-03-28 05:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497
2026-03-28 05:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with scrape type 2
2026-03-28 05:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with scrape type 2
2026-03-28 05:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e, identifier: FG94497
2026-03-28 05:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497
2026-03-28 05:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497
2026-03-28 05:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497 to the API
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:22:53Z',
 'fuel_type': 'diesel',
 'id': 'b7c6980b-7cb1-5b6f-846e-03dca8c11a0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG94497',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 311006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-01',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2014}
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-28 05:36:39 [auto1.de] INFO: Saving data for FG94497: {'auction_closing_time': 1774714973.0, 'created_time': 1773226162.563917, 'last_price_update_time': 1774676199.724146}
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG94497') HTTP/1.1" 204 0
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-28 05:36:39 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-28 05:36:39 [auto1.de] INFO: Scrape type for YT56915: 2
2026-03-28 05:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with identifier: YT56915
2026-03-28 05:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with scrape type 2
2026-03-28 05:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with scrape type 2
2026-03-28 05:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5, identifier: YT56915
2026-03-28 05:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with identifier: YT56915
2026-03-28 05:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with identifier: YT56915
2026-03-28 05:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with identifier: YT56915 to the API
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:13:31Z',
 'fuel_type': 'petrol',
 'id': '6c3a4ac7-72dd-5a38-a36e-7d9396be73e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT56915',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 145425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-09',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 Tekna 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna 4x4',
 'year': 2011}
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Saving data for YT56915: {'auction_closing_time': 1774714411.0, 'created_time': 1774589445.571612, 'last_price_update_time': 1774676200.269638}
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT56915') HTTP/1.1" 204 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for VH62706: 2
2026-03-28 05:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706
2026-03-28 05:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0daad80e-bf64-5947-9cef-59d26173ce6b with scrape type 2
2026-03-28 05:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0daad80e-bf64-5947-9cef-59d26173ce6b with scrape type 2
2026-03-28 05:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0daad80e-bf64-5947-9cef-59d26173ce6b, identifier: VH62706
2026-03-28 05:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706
2026-03-28 05:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706
2026-03-28 05:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706 to the API
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:32:09Z',
 'fuel_type': 'petrol',
 'id': '0daad80e-bf64-5947-9cef-59d26173ce6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH62706',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 149001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2017}
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Saving data for VH62706: {'auction_closing_time': 1774715529.0, 'created_time': 1774550684.020558, 'last_price_update_time': 1774676200.695581}
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH62706') HTTP/1.1" 204 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: MG11664
2026-03-28 05:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:41 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:41 [auto1.de] INFO: Found listing with ID: NV18768
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV18768%27 HTTP/1.1" 200 None
2026-03-28 05:36:41 [auto1.de] INFO: Scrape type for NV18768: 0
2026-03-28 05:36:41 [auto1.de] INFO: Found listing with ID: HM06155
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM06155%27 HTTP/1.1" 200 None
2026-03-28 05:36:41 [auto1.de] INFO: Scrape type for HM06155: 2
2026-03-28 05:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6f84079-ae85-50a3-861c-02ec4bdedc44 with identifier: HM06155
2026-03-28 05:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f84079-ae85-50a3-861c-02ec4bdedc44 with scrape type 2
2026-03-28 05:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6f84079-ae85-50a3-861c-02ec4bdedc44 with scrape type 2
2026-03-28 05:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6f84079-ae85-50a3-861c-02ec4bdedc44, identifier: HM06155
2026-03-28 05:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6f84079-ae85-50a3-861c-02ec4bdedc44 with identifier: HM06155
2026-03-28 05:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6f84079-ae85-50a3-861c-02ec4bdedc44 with identifier: HM06155
2026-03-28 05:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6f84079-ae85-50a3-861c-02ec4bdedc44 with identifier: HM06155 to the API
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:39:15Z',
 'fuel_type': 'diesel',
 'id': 'e6f84079-ae85-50a3-861c-02ec4bdedc44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM06155',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 107293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seller_name': None,
 'title': 'Opel Crossland X 1.5 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2019}
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM06155%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Saving data for HM06155: {'auction_closing_time': 1774715955.0, 'created_time': 1774467283.427411, 'last_price_update_time': 1774676202.331176}
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM06155') HTTP/1.1" 204 0
2026-03-28 05:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for SP10059: 2
2026-03-28 05:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059
2026-03-28 05:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with scrape type 2
2026-03-28 05:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with scrape type 2
2026-03-28 05:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a, identifier: SP10059
2026-03-28 05:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059
2026-03-28 05:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059
2026-03-28 05:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059 to the API
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:37Z',
 'fuel_type': 'petrol',
 'id': '8227b11b-d940-5c87-9b9b-f6735ec5ef9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP10059',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 140553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-08',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Saving data for SP10059: {'auction_closing_time': 1774715677.0, 'created_time': 1774550554.364328, 'last_price_update_time': 1774676202.771638}
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP10059') HTTP/1.1" 204 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: YW69752
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW69752%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for YW69752: 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80548%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for RX80548: 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: RJ91019
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: PM11705
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM11705%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for PM11705: 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: NW48345
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: CC77808
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: AJ11776
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11776%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for AJ11776: 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: CC84922
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: CS22727
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS22727%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for CS22727: 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for DF33717: 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: HT55645
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: TJ17702
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: WX42639
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: TE00128
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE00128%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for TE00128: 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for EH89058: 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for HW71141: 2
2026-03-28 05:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141
2026-03-28 05:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e93732eb-d180-5f0d-b1c8-ee587ec97272 with scrape type 2
2026-03-28 05:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e93732eb-d180-5f0d-b1c8-ee587ec97272 with scrape type 2
2026-03-28 05:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e93732eb-d180-5f0d-b1c8-ee587ec97272, identifier: HW71141
2026-03-28 05:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141
2026-03-28 05:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141
2026-03-28 05:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141 to the API
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:50:23Z',
 'fuel_type': 'petrol',
 'id': 'e93732eb-d180-5f0d-b1c8-ee587ec97272',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW71141',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 225463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-29',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2009}
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-28 05:36:43 [auto1.de] INFO: Saving data for HW71141: {'auction_closing_time': 1774716623.0, 'created_time': 1773303892.458719, 'last_price_update_time': 1774676203.362477}
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW71141') HTTP/1.1" 204 0
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: XZ20082
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: AZ20598
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM95018%27 HTTP/1.1" 200 None
2026-03-28 05:36:43 [auto1.de] INFO: Scrape type for HM95018: 0
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: PK12624
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-28 05:36:43 [auto1.de] INFO: Scrape type for TN09859: 0
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-28 05:36:43 [auto1.de] INFO: Scrape type for JT09686: 0
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: NU64349
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: MA95154
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA95154%27 HTTP/1.1" 200 None
2026-03-28 05:36:43 [auto1.de] INFO: Scrape type for MA95154: 2
2026-03-28 05:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 440b7d68-b166-5573-a75e-6762a113e7c4 with identifier: MA95154
2026-03-28 05:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 440b7d68-b166-5573-a75e-6762a113e7c4 with scrape type 2
2026-03-28 05:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 440b7d68-b166-5573-a75e-6762a113e7c4 with scrape type 2
2026-03-28 05:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 440b7d68-b166-5573-a75e-6762a113e7c4, identifier: MA95154
2026-03-28 05:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 440b7d68-b166-5573-a75e-6762a113e7c4 with identifier: MA95154
2026-03-28 05:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 440b7d68-b166-5573-a75e-6762a113e7c4 with identifier: MA95154
2026-03-28 05:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 440b7d68-b166-5573-a75e-6762a113e7c4 with identifier: MA95154 to the API
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:04:08Z',
 'fuel_type': 'petrol',
 'id': '440b7d68-b166-5573-a75e-6762a113e7c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA95154',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 18496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-08',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Mild-Hybrid Evolution',
 'transmission': 'automatic',
 'trim': 'Evolution',
 'year': 2023}
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA95154%27 HTTP/1.1" 200 None
2026-03-28 05:36:43 [auto1.de] INFO: Saving data for MA95154: {'auction_closing_time': 1774713848.0, 'created_time': 1774466225.773345, 'last_price_update_time': 1774676203.93911}
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA95154') HTTP/1.1" 204 0
2026-03-28 05:36:44 [auto1.de] INFO: Found listing with ID: VM08251
2026-03-28 05:36:44 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA27483%27 HTTP/1.1" 200 None
2026-03-28 05:36:44 [auto1.de] INFO: Scrape type for ZA27483: 2
2026-03-28 05:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483
2026-03-28 05:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82144a3-7d52-5b21-9917-ad8fe8418b67 with scrape type 2
2026-03-28 05:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f82144a3-7d52-5b21-9917-ad8fe8418b67 with scrape type 2
2026-03-28 05:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f82144a3-7d52-5b21-9917-ad8fe8418b67, identifier: ZA27483
2026-03-28 05:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483
2026-03-28 05:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483
2026-03-28 05:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483 to the API
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:24:26Z',
 'fuel_type': 'petrol',
 'id': 'f82144a3-7d52-5b21-9917-ad8fe8418b67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA27483',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 50250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA27483%27 HTTP/1.1" 200 None
2026-03-28 05:36:44 [auto1.de] INFO: Saving data for ZA27483: {'auction_closing_time': 1774715066.0, 'created_time': 1773340807.798658, 'last_price_update_time': 1774676204.493052}
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA27483') HTTP/1.1" 204 0
2026-03-28 05:36:44 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-28 05:36:44 [auto1.de] INFO: Found listing with ID: SV97177
2026-03-28 05:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:45 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: LS85848
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: MA92552
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: WV31181
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV31181%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Scrape type for WV31181: 0
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: WP06272
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: NV65753
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: US20964
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: YP19637
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: GG55912
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG55912%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Scrape type for GG55912: 0
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: LE07247
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE07247%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Scrape type for LE07247: 2
2026-03-28 05:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f37b4458-dd2f-5caa-94b2-ec5bd656032f with identifier: LE07247
2026-03-28 05:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f37b4458-dd2f-5caa-94b2-ec5bd656032f with scrape type 2
2026-03-28 05:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f37b4458-dd2f-5caa-94b2-ec5bd656032f with scrape type 2
2026-03-28 05:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f37b4458-dd2f-5caa-94b2-ec5bd656032f, identifier: LE07247
2026-03-28 05:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f37b4458-dd2f-5caa-94b2-ec5bd656032f with identifier: LE07247
2026-03-28 05:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f37b4458-dd2f-5caa-94b2-ec5bd656032f with identifier: LE07247
2026-03-28 05:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f37b4458-dd2f-5caa-94b2-ec5bd656032f with identifier: LE07247 to the API
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:23Z',
 'fuel_type': 'diesel',
 'id': 'f37b4458-dd2f-5caa-94b2-ec5bd656032f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE07247',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 194384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-05',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2014}
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE07247%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Saving data for LE07247: {'auction_closing_time': 1774714523.0, 'created_time': 1773859356.212367, 'last_price_update_time': 1774676205.756617}
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE07247') HTTP/1.1" 204 0
2026-03-28 05:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Scrape type for GM00936: 2
2026-03-28 05:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with identifier: GM00936
2026-03-28 05:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with scrape type 2
2026-03-28 05:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with scrape type 2
2026-03-28 05:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ec060c8-b1b5-56eb-931d-2f61ccb741ab, identifier: GM00936
2026-03-28 05:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with identifier: GM00936
2026-03-28 05:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with identifier: GM00936
2026-03-28 05:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with identifier: GM00936 to the API
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:00:38Z',
 'fuel_type': 'petrol',
 'id': '6ec060c8-b1b5-56eb-931d-2f61ccb741ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM00936',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 160175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-17',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Sport Active',
 'transmission': 'manual',
 'trim': 'Sport Active',
 'year': 2006}
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-28 05:36:46 [auto1.de] INFO: Saving data for GM00936: {'auction_closing_time': 1774713638.0, 'created_time': 1774550987.215812, 'last_price_update_time': 1774676206.284334}
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM00936') HTTP/1.1" 204 0
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: KE58425
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE58425%27 HTTP/1.1" 200 None
2026-03-28 05:36:46 [auto1.de] INFO: Scrape type for KE58425: 0
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-28 05:36:46 [auto1.de] INFO: Scrape type for EB96923: 2
2026-03-28 05:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923
2026-03-28 05:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2183a198-b484-514a-844d-ab161ab3696a with scrape type 2
2026-03-28 05:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2183a198-b484-514a-844d-ab161ab3696a with scrape type 2
2026-03-28 05:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2183a198-b484-514a-844d-ab161ab3696a, identifier: EB96923
2026-03-28 05:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923
2026-03-28 05:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923
2026-03-28 05:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923 to the API
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-28T16:32:08Z',
 'fuel_type': 'diesel',
 'id': '2183a198-b484-514a-844d-ab161ab3696a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB96923',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 113812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Ocean',
 'transmission': 'automatic',
 'trim': 'Ocean',
 'year': 2019}
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-28 05:36:46 [auto1.de] INFO: Saving data for EB96923: {'auction_closing_time': 1774715528.0, 'created_time': 1774552618.110459, 'last_price_update_time': 1774676206.734697}
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB96923') HTTP/1.1" 204 0
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: UC67587
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: MT37929
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT37929%27 HTTP/1.1" 200 None
2026-03-28 05:36:46 [auto1.de] INFO: Scrape type for MT37929: 2
2026-03-28 05:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b97dcfec-f9ca-5836-94aa-1490feb90782 with identifier: MT37929
2026-03-28 05:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b97dcfec-f9ca-5836-94aa-1490feb90782 with scrape type 2
2026-03-28 05:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b97dcfec-f9ca-5836-94aa-1490feb90782 with scrape type 2
2026-03-28 05:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b97dcfec-f9ca-5836-94aa-1490feb90782, identifier: MT37929
2026-03-28 05:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b97dcfec-f9ca-5836-94aa-1490feb90782 with identifier: MT37929
2026-03-28 05:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b97dcfec-f9ca-5836-94aa-1490feb90782 with identifier: MT37929
2026-03-28 05:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b97dcfec-f9ca-5836-94aa-1490feb90782 with identifier: MT37929 to the API
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:32:09Z',
 'fuel_type': 'petrol',
 'id': 'b97dcfec-f9ca-5836-94aa-1490feb90782',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT37929',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 52739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT37929%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Saving data for MT37929: {'auction_closing_time': 1774715529.0, 'created_time': 1774466833.908369, 'last_price_update_time': 1774676207.173733}
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT37929') HTTP/1.1" 204 0
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: NN70157
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN70157%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for NN70157: 0
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: PB76080
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB76080%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for PB76080: 0
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: ZZ70410
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ70410%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for ZZ70410: 0
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: MB01512
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB01512%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for MB01512: 0
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: JE38755
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for WG75781: 2
2026-03-28 05:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781
2026-03-28 05:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with scrape type 2
2026-03-28 05:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with scrape type 2
2026-03-28 05:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f, identifier: WG75781
2026-03-28 05:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781
2026-03-28 05:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781
2026-03-28 05:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781 to the API
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:44Z',
 'fuel_type': 'diesel',
 'id': 'cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG75781',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 41915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Saving data for WG75781: {'auction_closing_time': 1774715564.0, 'created_time': 1773344911.66281, 'last_price_update_time': 1774676207.741667}
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG75781') HTTP/1.1" 204 0
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: DL07796
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL07796%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for DL07796: 2
2026-03-28 05:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with identifier: DL07796
2026-03-28 05:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with scrape type 2
2026-03-28 05:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with scrape type 2
2026-03-28 05:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c15999e-4154-5e02-b72c-e9f3f980d4b4, identifier: DL07796
2026-03-28 05:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with identifier: DL07796
2026-03-28 05:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with identifier: DL07796
2026-03-28 05:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c15999e-4154-5e02-b72c-e9f3f980d4b4 with identifier: DL07796 to the API
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:59:51Z',
 'fuel_type': 'diesel',
 'id': '2c15999e-4154-5e02-b72c-e9f3f980d4b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL07796',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 244763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL07796%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Saving data for DL07796: {'auction_closing_time': 1774717191.0, 'created_time': 1774463660.208001, 'last_price_update_time': 1774676208.353084}
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL07796') HTTP/1.1" 204 0
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: ZW75307
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW75307%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Scrape type for ZW75307: 2
2026-03-28 05:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7861e5-b0c1-57b0-a02e-4f756b7ee79e with identifier: ZW75307
2026-03-28 05:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7861e5-b0c1-57b0-a02e-4f756b7ee79e with scrape type 2
2026-03-28 05:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c7861e5-b0c1-57b0-a02e-4f756b7ee79e with scrape type 2
2026-03-28 05:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c7861e5-b0c1-57b0-a02e-4f756b7ee79e, identifier: ZW75307
2026-03-28 05:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c7861e5-b0c1-57b0-a02e-4f756b7ee79e with identifier: ZW75307
2026-03-28 05:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c7861e5-b0c1-57b0-a02e-4f756b7ee79e with identifier: ZW75307
2026-03-28 05:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c7861e5-b0c1-57b0-a02e-4f756b7ee79e with identifier: ZW75307 to the API
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:16:57Z',
 'fuel_type': 'diesel',
 'id': '9c7861e5-b0c1-57b0-a02e-4f756b7ee79e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW75307',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 157364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-14',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW75307%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Saving data for ZW75307: {'auction_closing_time': 1774714617.0, 'created_time': 1774466464.268392, 'last_price_update_time': 1774676208.797171}
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW75307') HTTP/1.1" 204 0
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Scrape type for XZ94866: 2
2026-03-28 05:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866
2026-03-28 05:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fca553d1-f666-5f50-9e7e-ec2e32e44e92 with scrape type 2
2026-03-28 05:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fca553d1-f666-5f50-9e7e-ec2e32e44e92 with scrape type 2
2026-03-28 05:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fca553d1-f666-5f50-9e7e-ec2e32e44e92, identifier: XZ94866
2026-03-28 05:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866
2026-03-28 05:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866
2026-03-28 05:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866 to the API
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:50:09Z',
 'fuel_type': 'diesel',
 'id': 'fca553d1-f666-5f50-9e7e-ec2e32e44e92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ94866',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 210370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-02-25',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 112 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Saving data for XZ94866: {'auction_closing_time': 1774716609.0, 'created_time': 1774551273.716558, 'last_price_update_time': 1774676209.230382}
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ94866') HTTP/1.1" 204 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for AG38936: 2
2026-03-28 05:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with identifier: AG38936
2026-03-28 05:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with scrape type 2
2026-03-28 05:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with scrape type 2
2026-03-28 05:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d758cdc6-c644-5df0-96be-71b2ce8e3fd6, identifier: AG38936
2026-03-28 05:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with identifier: AG38936
2026-03-28 05:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with identifier: AG38936
2026-03-28 05:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with identifier: AG38936 to the API
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:23:16Z',
 'fuel_type': 'diesel',
 'id': 'd758cdc6-c644-5df0-96be-71b2ce8e3fd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG38936',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 280796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-31',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2014}
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Saving data for AG38936: {'auction_closing_time': 1774714996.0, 'created_time': 1773917253.086387, 'last_price_update_time': 1774676209.685198}
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG38936') HTTP/1.1" 204 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: RU20217
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU20217%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for RU20217: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: BK73994
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for DZ61875: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: LC23112
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC23112%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for LC23112: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: RH56837
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH56837%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for RH56837: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: CW66506
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for TD56842: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for PL23541: 2
2026-03-28 05:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541
2026-03-28 05:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with scrape type 2
2026-03-28 05:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with scrape type 2
2026-03-28 05:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd, identifier: PL23541
2026-03-28 05:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541
2026-03-28 05:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541
2026-03-28 05:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541 to the API
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:45:48Z',
 'fuel_type': 'petrol',
 'id': '2aa0930a-4fd3-55bd-a021-cb148c9dfebd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL23541',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 236601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Saving data for PL23541: {'auction_closing_time': 1774716348.0, 'created_time': 1774552679.213452, 'last_price_update_time': 1774676210.204642}
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL23541') HTTP/1.1" 204 0
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: NH37075
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH37075%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Scrape type for NH37075: 0
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54130%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Scrape type for GT54130: 0
2026-03-28 05:36:50 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: UC67308
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: RL82017
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL82017%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Scrape type for RL82017: 0
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: RE74325
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: AC78646
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Scrape type for SA50642: 0
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Scrape type for JT67031: 2
2026-03-28 05:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with identifier: JT67031
2026-03-28 05:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with scrape type 2
2026-03-28 05:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with scrape type 2
2026-03-28 05:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139, identifier: JT67031
2026-03-28 05:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with identifier: JT67031
2026-03-28 05:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with identifier: JT67031
2026-03-28 05:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with identifier: JT67031 to the API
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:08:12Z',
 'fuel_type': 'petrol',
 'id': '95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT67031',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 43126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-04',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2018}
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Saving data for JT67031: {'auction_closing_time': 1774714092.0, 'created_time': 1774551856.33581, 'last_price_update_time': 1774676210.861904}
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT67031') HTTP/1.1" 204 0
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: WT87490
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT87490%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Scrape type for WT87490: 0
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: LS17715
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: AZ58179
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: LY90714
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY90714%27 HTTP/1.1" 200 None
2026-03-28 05:36:51 [auto1.de] INFO: Scrape type for LY90714: 0
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: DF13757
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF13757%27 HTTP/1.1" 200 None
2026-03-28 05:36:51 [auto1.de] INFO: Scrape type for DF13757: 0
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: HH97697
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: AA51268
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51268%27 HTTP/1.1" 200 None
2026-03-28 05:36:51 [auto1.de] INFO: Scrape type for AA51268: 0
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-28 05:36:51 [auto1.de] INFO: Scrape type for UM78498: 2
2026-03-28 05:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60bbf222-297a-5e1d-937a-be462ff27e02 with identifier: UM78498
2026-03-28 05:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60bbf222-297a-5e1d-937a-be462ff27e02 with scrape type 2
2026-03-28 05:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60bbf222-297a-5e1d-937a-be462ff27e02 with scrape type 2
2026-03-28 05:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60bbf222-297a-5e1d-937a-be462ff27e02, identifier: UM78498
2026-03-28 05:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60bbf222-297a-5e1d-937a-be462ff27e02 with identifier: UM78498
2026-03-28 05:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60bbf222-297a-5e1d-937a-be462ff27e02 with identifier: UM78498
2026-03-28 05:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60bbf222-297a-5e1d-937a-be462ff27e02 with identifier: UM78498 to the API
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:06:30Z',
 'fuel_type': 'diesel',
 'id': '60bbf222-297a-5e1d-937a-be462ff27e02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM78498',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 166972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-19',
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 CDTI M Tourer L2',
 'transmission': 'automatic',
 'trim': 'M Tourer L2',
 'year': 2021}
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Saving data for UM78498: {'auction_closing_time': 1774713990.0, 'created_time': 1774552896.802398, 'last_price_update_time': 1774676212.018663}
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM78498') HTTP/1.1" 204 0
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: UJ05143
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ05143%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Scrape type for UJ05143: 0
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Scrape type for EU79634: 2
2026-03-28 05:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634
2026-03-28 05:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 978faa5d-a950-51ce-af1a-d25f2c2e3856 with scrape type 2
2026-03-28 05:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 978faa5d-a950-51ce-af1a-d25f2c2e3856 with scrape type 2
2026-03-28 05:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 978faa5d-a950-51ce-af1a-d25f2c2e3856, identifier: EU79634
2026-03-28 05:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634
2026-03-28 05:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634
2026-03-28 05:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634 to the API
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:41:19Z',
 'fuel_type': 'petrol',
 'id': '978faa5d-a950-51ce-af1a-d25f2c2e3856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU79634',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 229267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-06',
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2009}
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Saving data for EU79634: {'auction_closing_time': 1774716079.0, 'created_time': 1774550403.534053, 'last_price_update_time': 1774676212.477572}
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU79634') HTTP/1.1" 204 0
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: RY54075
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: ZX49243
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: SH34728
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: ZZ68403
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ68403%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Scrape type for ZZ68403: 0
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: SZ88186
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: DL39221
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: WZ31189
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ31189%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Scrape type for WZ31189: 0
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: RS00302
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: TU46947
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU46947%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Scrape type for TU46947: 2
2026-03-28 05:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57064989-4169-53eb-9ce6-2ba03d406890 with identifier: TU46947
2026-03-28 05:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57064989-4169-53eb-9ce6-2ba03d406890 with scrape type 2
2026-03-28 05:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57064989-4169-53eb-9ce6-2ba03d406890 with scrape type 2
2026-03-28 05:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57064989-4169-53eb-9ce6-2ba03d406890, identifier: TU46947
2026-03-28 05:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57064989-4169-53eb-9ce6-2ba03d406890 with identifier: TU46947
2026-03-28 05:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57064989-4169-53eb-9ce6-2ba03d406890 with identifier: TU46947
2026-03-28 05:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57064989-4169-53eb-9ce6-2ba03d406890 with identifier: TU46947 to the API
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:58:16Z',
 'fuel_type': 'petrol',
 'id': '57064989-4169-53eb-9ce6-2ba03d406890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU46947',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Alto',
 'odometer': 137063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seller_name': None,
 'title': 'Suzuki Alto 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2012}
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU46947%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Saving data for TU46947: {'auction_closing_time': 1774717096.0, 'created_time': 1774467603.592097, 'last_price_update_time': 1774676213.104119}
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU46947') HTTP/1.1" 204 0
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: DN68550
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: JW69458
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW69458%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Scrape type for JW69458: 0
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: SC69057
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: ST98155
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98155%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Scrape type for ST98155: 0
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: CR90100
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR90100%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Scrape type for CR90100: 0
2026-03-28 05:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:54 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for VW19119: 0
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for GL29302: 0
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: HX20102
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: LS81640
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: HG98131
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for KY67779: 2
2026-03-28 05:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c4b51a-0957-51e0-90e8-b89f951ed411 with identifier: KY67779
2026-03-28 05:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c4b51a-0957-51e0-90e8-b89f951ed411 with scrape type 2
2026-03-28 05:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8c4b51a-0957-51e0-90e8-b89f951ed411 with scrape type 2
2026-03-28 05:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8c4b51a-0957-51e0-90e8-b89f951ed411, identifier: KY67779
2026-03-28 05:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8c4b51a-0957-51e0-90e8-b89f951ed411 with identifier: KY67779
2026-03-28 05:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8c4b51a-0957-51e0-90e8-b89f951ed411 with identifier: KY67779
2026-03-28 05:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8c4b51a-0957-51e0-90e8-b89f951ed411 with identifier: KY67779 to the API
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:22:40Z',
 'fuel_type': 'diesel',
 'id': 'e8c4b51a-0957-51e0-90e8-b89f951ed411',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY67779',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 123762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-21',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Saving data for KY67779: {'auction_closing_time': 1774714960.0, 'created_time': 1774550422.090237, 'last_price_update_time': 1774676214.576908}
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY67779') HTTP/1.1" 204 0
2026-03-28 05:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: JU56361
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU56361%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for JU56361: 0
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: FW67106
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW67106%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for FW67106: 0
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for BF09730: 2
2026-03-28 05:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with identifier: BF09730
2026-03-28 05:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with scrape type 2
2026-03-28 05:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with scrape type 2
2026-03-28 05:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3525e7ab-71b1-54cc-a8da-9d891ca395b6, identifier: BF09730
2026-03-28 05:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with identifier: BF09730
2026-03-28 05:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with identifier: BF09730
2026-03-28 05:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with identifier: BF09730 to the API
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:18:35Z',
 'fuel_type': 'petrol',
 'id': '3525e7ab-71b1-54cc-a8da-9d891ca395b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF09730',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 114797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-12',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2010}
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Saving data for BF09730: {'auction_closing_time': 1774714715.0, 'created_time': 1774553006.865527, 'last_price_update_time': 1774676215.1303}
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF09730') HTTP/1.1" 204 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: BG13362
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13362%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Scrape type for BG13362: 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB30141%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Scrape type for DB30141: 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: HM53441
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW56933%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Scrape type for XW56933: 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: GW59315
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW59315%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Scrape type for GW59315: 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: JT68679
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: UC16251
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC16251%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Scrape type for UC16251: 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Scrape type for DC50657: 2
2026-03-28 05:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657
2026-03-28 05:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with scrape type 2
2026-03-28 05:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with scrape type 2
2026-03-28 05:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1, identifier: DC50657
2026-03-28 05:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657
2026-03-28 05:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657
2026-03-28 05:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657 to the API
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:42:12Z',
 'fuel_type': 'petrol',
 'id': 'fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC50657',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 94991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Saving data for DC50657: {'auction_closing_time': 1774716132.0, 'created_time': 1774553087.557671, 'last_price_update_time': 1774676215.666266}
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC50657') HTTP/1.1" 204 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: JH03969
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Scrape type for JT24059: 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: HZ59997
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: DN67284
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN67284%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Scrape type for DN67284: 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Scrape type for HB62696: 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: VS07108
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS07108%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Scrape type for VS07108: 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: CV73589
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: ND37325
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND37325%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Scrape type for ND37325: 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: DP75483
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: HX17640
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: NU59007
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: AD58556
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: XW64211
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: HN56676
2026-03-28 05:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:56 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87515%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Scrape type for HP87515: 0
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Scrape type for YT53234: 0
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: UD93265
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: RE14454
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: DP99201
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP99201%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Scrape type for DP99201: 0
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: BR35600
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR35600%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Scrape type for BR35600: 2
2026-03-28 05:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 738ead1e-6c7b-586f-a6cc-154dc77cf73d with identifier: BR35600
2026-03-28 05:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 738ead1e-6c7b-586f-a6cc-154dc77cf73d with scrape type 2
2026-03-28 05:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 738ead1e-6c7b-586f-a6cc-154dc77cf73d with scrape type 2
2026-03-28 05:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 738ead1e-6c7b-586f-a6cc-154dc77cf73d, identifier: BR35600
2026-03-28 05:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 738ead1e-6c7b-586f-a6cc-154dc77cf73d with identifier: BR35600
2026-03-28 05:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 738ead1e-6c7b-586f-a6cc-154dc77cf73d with identifier: BR35600
2026-03-28 05:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 738ead1e-6c7b-586f-a6cc-154dc77cf73d with identifier: BR35600 to the API
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:58:55Z',
 'fuel_type': 'petrol',
 'id': '738ead1e-6c7b-586f-a6cc-154dc77cf73d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR35600',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 133739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-09',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Classic blue 2WD',
 'transmission': 'manual',
 'trim': 'Classic blue 2WD',
 'year': 2016}
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR35600%27 HTTP/1.1" 200 None
2026-03-28 05:36:57 [auto1.de] INFO: Saving data for BR35600: {'auction_closing_time': 1774717135.0, 'created_time': 1774466141.177168, 'last_price_update_time': 1774676217.162285}
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR35600') HTTP/1.1" 204 0
2026-03-28 05:36:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-28 05:36:57 [auto1.de] INFO: Scrape type for KB55712: 2
2026-03-28 05:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with identifier: KB55712
2026-03-28 05:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with scrape type 2
2026-03-28 05:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with scrape type 2
2026-03-28 05:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f82ae2ed-51d0-5ab3-bdb5-a89c368af251, identifier: KB55712
2026-03-28 05:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with identifier: KB55712
2026-03-28 05:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with identifier: KB55712
2026-03-28 05:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with identifier: KB55712 to the API
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:21:23Z',
 'fuel_type': 'petrol',
 'id': 'f82ae2ed-51d0-5ab3-bdb5-a89c368af251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB55712',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 71330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-28 05:36:57 [auto1.de] INFO: Saving data for KB55712: {'auction_closing_time': 1774714883.0, 'created_time': 1773946253.72192, 'last_price_update_time': 1774676217.686154}
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB55712') HTTP/1.1" 204 0
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: RZ67048
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: MG85593
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: FB64910
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB64910%27 HTTP/1.1" 200 None
2026-03-28 05:36:57 [auto1.de] INFO: Scrape type for FB64910: 0
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: KN24500
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN24500%27 HTTP/1.1" 200 None
2026-03-28 05:36:57 [auto1.de] INFO: Scrape type for KN24500: 0
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: RU77143
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: CP51565
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: BE71150
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE71150%27 HTTP/1.1" 200 None
2026-03-28 05:36:57 [auto1.de] INFO: Scrape type for BE71150: 2
2026-03-28 05:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b32f6c25-a124-5f0b-bf2c-92bfe377ca80 with identifier: BE71150
2026-03-28 05:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b32f6c25-a124-5f0b-bf2c-92bfe377ca80 with scrape type 2
2026-03-28 05:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b32f6c25-a124-5f0b-bf2c-92bfe377ca80 with scrape type 2
2026-03-28 05:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b32f6c25-a124-5f0b-bf2c-92bfe377ca80, identifier: BE71150
2026-03-28 05:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b32f6c25-a124-5f0b-bf2c-92bfe377ca80 with identifier: BE71150
2026-03-28 05:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b32f6c25-a124-5f0b-bf2c-92bfe377ca80 with identifier: BE71150
2026-03-28 05:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b32f6c25-a124-5f0b-bf2c-92bfe377ca80 with identifier: BE71150 to the API
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:11:36Z',
 'fuel_type': 'petrol',
 'id': 'b32f6c25-a124-5f0b-bf2c-92bfe377ca80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE71150',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 147540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-30',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2012}
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE71150%27 HTTP/1.1" 200 None
2026-03-28 05:36:58 [auto1.de] INFO: Saving data for BE71150: {'auction_closing_time': 1774714296.0, 'created_time': 1774463681.552598, 'last_price_update_time': 1774676218.18407}
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE71150') HTTP/1.1" 204 0
2026-03-28 05:36:58 [auto1.de] INFO: Found listing with ID: GB40015
2026-03-28 05:36:58 [auto1.de] INFO: Found listing with ID: HJ82357
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ82357%27 HTTP/1.1" 200 None
2026-03-28 05:36:58 [auto1.de] INFO: Scrape type for HJ82357: 2
2026-03-28 05:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c587f37f-db5f-58d2-b013-4d99a82b7898 with identifier: HJ82357
2026-03-28 05:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c587f37f-db5f-58d2-b013-4d99a82b7898 with scrape type 2
2026-03-28 05:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c587f37f-db5f-58d2-b013-4d99a82b7898 with scrape type 2
2026-03-28 05:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c587f37f-db5f-58d2-b013-4d99a82b7898, identifier: HJ82357
2026-03-28 05:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c587f37f-db5f-58d2-b013-4d99a82b7898 with identifier: HJ82357
2026-03-28 05:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c587f37f-db5f-58d2-b013-4d99a82b7898 with identifier: HJ82357
2026-03-28 05:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c587f37f-db5f-58d2-b013-4d99a82b7898 with identifier: HJ82357 to the API
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:32:48Z',
 'fuel_type': 'petrol',
 'id': 'c587f37f-db5f-58d2-b013-4d99a82b7898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ82357',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 59877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-28',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ82357%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Saving data for HJ82357: {'auction_closing_time': 1774715568.0, 'created_time': 1774552845.263633, 'last_price_update_time': 1774676219.069331}
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ82357') HTTP/1.1" 204 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: JK15259
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: RV63861
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: PL20844
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL20844%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for PL20844: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: ZG66499
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG66499%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for ZG66499: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for KJ96980: 2
2026-03-28 05:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980
2026-03-28 05:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with scrape type 2
2026-03-28 05:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with scrape type 2
2026-03-28 05:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d, identifier: KJ96980
2026-03-28 05:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980
2026-03-28 05:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980
2026-03-28 05:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980 to the API
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:41:14Z',
 'fuel_type': 'diesel',
 'id': '275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ96980',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 176538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2017}
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Saving data for KJ96980: {'auction_closing_time': 1774716074.0, 'created_time': 1774550869.884903, 'last_price_update_time': 1774676219.531994}
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ96980') HTTP/1.1" 204 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: KL17270
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for JV77194: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for ED89448: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for RL23601: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for EB22696: 2
2026-03-28 05:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696
2026-03-28 05:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28d10e40-832c-54a6-8225-7b5773fad699 with scrape type 2
2026-03-28 05:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28d10e40-832c-54a6-8225-7b5773fad699 with scrape type 2
2026-03-28 05:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28d10e40-832c-54a6-8225-7b5773fad699, identifier: EB22696
2026-03-28 05:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696
2026-03-28 05:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696
2026-03-28 05:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696 to the API
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:37:47Z',
 'fuel_type': 'petrol',
 'id': '28d10e40-832c-54a6-8225-7b5773fad699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB22696',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 175697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-20',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Saving data for EB22696: {'auction_closing_time': 1774715867.0, 'created_time': 1774550458.973322, 'last_price_update_time': 1774676220.087642}
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB22696') HTTP/1.1" 204 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: BY18801
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: CC51739
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC51739%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for CC51739: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: ZL98150
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: PL06364
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: EG86268
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG86268%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for EG86268: 0
2026-03-28 05:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:00 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: NF90581
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: VZ02719
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ02719%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for VZ02719: 2
2026-03-28 05:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c727a82a-57bc-5edb-b604-24d7e752e77f with identifier: VZ02719
2026-03-28 05:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c727a82a-57bc-5edb-b604-24d7e752e77f with scrape type 2
2026-03-28 05:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c727a82a-57bc-5edb-b604-24d7e752e77f with scrape type 2
2026-03-28 05:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c727a82a-57bc-5edb-b604-24d7e752e77f, identifier: VZ02719
2026-03-28 05:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c727a82a-57bc-5edb-b604-24d7e752e77f with identifier: VZ02719
2026-03-28 05:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c727a82a-57bc-5edb-b604-24d7e752e77f with identifier: VZ02719
2026-03-28 05:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c727a82a-57bc-5edb-b604-24d7e752e77f with identifier: VZ02719 to the API
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:47:37Z',
 'fuel_type': 'diesel',
 'id': 'c727a82a-57bc-5edb-b604-24d7e752e77f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ02719',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 167268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-20',
 'seller_name': None,
 'title': 'Audi A5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ02719%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Saving data for VZ02719: {'auction_closing_time': 1774716457.0, 'created_time': 1774463720.68124, 'last_price_update_time': 1774676221.270821}
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ02719') HTTP/1.1" 204 0
2026-03-28 05:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for TU73668: 0
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: XZ84287
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ84287%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for XZ84287: 0
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: GZ66698
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: DK78572
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK78572%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for DK78572: 0
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: PE88762
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88762%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for PE88762: 0
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for YN38539: 2
2026-03-28 05:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539
2026-03-28 05:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with scrape type 2
2026-03-28 05:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with scrape type 2
2026-03-28 05:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7, identifier: YN38539
2026-03-28 05:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539
2026-03-28 05:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539
2026-03-28 05:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539 to the API
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:35:36Z',
 'fuel_type': 'petrol',
 'id': '47b7bfe3-ae4d-5e64-9d48-b368bc428fe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN38539',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Stratus',
 'odometer': 69735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-04-29',
 'seller_name': None,
 'title': 'Chrysler Stratus 2.5 V6 LX',
 'transmission': 'automatic',
 'trim': 'V6 LX',
 'year': 1998}
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Saving data for YN38539: {'auction_closing_time': 1774715736.0, 'created_time': 1773228688.002477, 'last_price_update_time': 1774676221.812517}
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN38539') HTTP/1.1" 204 0
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: TW63650
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: AU05759
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU05759%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for AU05759: 0
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: HM98480
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM98480%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for HM98480: 0
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: UP04235
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: BN05561
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: BA46324
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: EP52094
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: SR37454
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR37454%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for SR37454: 0
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for GC30737: 0
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: XA77724
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: WF16279
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16279%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for WF16279: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for PW08848: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: FR35172
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: FT74133
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT74133%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for FT74133: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: UB38135
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: PV29285
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV29285%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for PV29285: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: XZ91818
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ91818%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for XZ91818: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: EV41055
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV41055%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for EV41055: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for FY22177: 2
2026-03-28 05:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e59ee88a-eca5-529c-9114-be1793f37cd1 with identifier: FY22177
2026-03-28 05:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e59ee88a-eca5-529c-9114-be1793f37cd1 with scrape type 2
2026-03-28 05:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e59ee88a-eca5-529c-9114-be1793f37cd1 with scrape type 2
2026-03-28 05:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e59ee88a-eca5-529c-9114-be1793f37cd1, identifier: FY22177
2026-03-28 05:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e59ee88a-eca5-529c-9114-be1793f37cd1 with identifier: FY22177
2026-03-28 05:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e59ee88a-eca5-529c-9114-be1793f37cd1 with identifier: FY22177
2026-03-28 05:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e59ee88a-eca5-529c-9114-be1793f37cd1 with identifier: FY22177 to the API
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:15:19Z',
 'fuel_type': 'petrol',
 'id': 'e59ee88a-eca5-529c-9114-be1793f37cd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY22177',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 126172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-25',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2014}
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Saving data for FY22177: {'auction_closing_time': 1774714519.0, 'created_time': 1774550439.587098, 'last_price_update_time': 1774676222.502622}
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY22177') HTTP/1.1" 204 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: ME37510
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME37510%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for ME37510: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: JC38309
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC38309%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for JC38309: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: WS06283
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06283%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for WS06283: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for WL10604: 2
2026-03-28 05:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c49af2ac-2335-5f67-9183-7fb3fb493cfd with identifier: WL10604
2026-03-28 05:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c49af2ac-2335-5f67-9183-7fb3fb493cfd with scrape type 2
2026-03-28 05:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c49af2ac-2335-5f67-9183-7fb3fb493cfd with scrape type 2
2026-03-28 05:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c49af2ac-2335-5f67-9183-7fb3fb493cfd, identifier: WL10604
2026-03-28 05:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c49af2ac-2335-5f67-9183-7fb3fb493cfd with identifier: WL10604
2026-03-28 05:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c49af2ac-2335-5f67-9183-7fb3fb493cfd with identifier: WL10604
2026-03-28 05:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c49af2ac-2335-5f67-9183-7fb3fb493cfd with identifier: WL10604 to the API
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:12:24Z',
 'fuel_type': 'petrol',
 'id': 'c49af2ac-2335-5f67-9183-7fb3fb493cfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL10604',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 137581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-27',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 DSi LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2006}
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-28 05:37:03 [auto1.de] INFO: Saving data for WL10604: {'auction_closing_time': 1774714344.0, 'created_time': 1774551855.364848, 'last_price_update_time': 1774676223.13095}
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL10604') HTTP/1.1" 204 0
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: BF71090
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: GU34646
2026-03-28 05:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:04 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Scrape type for BJ98180: 2
2026-03-28 05:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180
2026-03-28 05:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f938a2-302a-502b-8ae2-c5bd24720d71 with scrape type 2
2026-03-28 05:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67f938a2-302a-502b-8ae2-c5bd24720d71 with scrape type 2
2026-03-28 05:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67f938a2-302a-502b-8ae2-c5bd24720d71, identifier: BJ98180
2026-03-28 05:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180
2026-03-28 05:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180
2026-03-28 05:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180 to the API
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:41:01Z',
 'fuel_type': 'diesel',
 'id': '67f938a2-302a-502b-8ae2-c5bd24720d71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ98180',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 313282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
 'transmission': 'automatic',
 'trim': 'Scout 4x4',
 'year': 2019}
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Saving data for BJ98180: {'auction_closing_time': 1774716061.0, 'created_time': 1773916500.862034, 'last_price_update_time': 1774676224.538186}
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ98180') HTTP/1.1" 204 0
2026-03-28 05:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: VE89968
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: CE62650
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: HE47974
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47974%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Scrape type for HE47974: 0
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: KF09771
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF09771%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Scrape type for KF09771: 0
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: PT72928
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: KR79365
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR79365%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Scrape type for KR79365: 0
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02841%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Scrape type for FB02841: 0
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: FC01823
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Scrape type for AS86297: 0
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Scrape type for KV45181: 2
2026-03-28 05:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with identifier: KV45181
2026-03-28 05:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with scrape type 2
2026-03-28 05:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with scrape type 2
2026-03-28 05:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62d52e27-ce30-5fcc-9201-1aa6eadf7521, identifier: KV45181
2026-03-28 05:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with identifier: KV45181
2026-03-28 05:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with identifier: KV45181
2026-03-28 05:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with identifier: KV45181 to the API
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:02:16Z',
 'fuel_type': 'petrol',
 'id': '62d52e27-ce30-5fcc-9201-1aa6eadf7521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV45181',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 227132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-13',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 City',
 'transmission': 'manual',
 'trim': 'City',
 'year': 2005}
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-28 05:37:05 [auto1.de] INFO: Saving data for KV45181: {'auction_closing_time': 1774713736.0, 'created_time': 1774550666.737614, 'last_price_update_time': 1774676225.197254}
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV45181') HTTP/1.1" 204 0
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-28 05:37:05 [auto1.de] INFO: Scrape type for ZW22458: 2
2026-03-28 05:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458
2026-03-28 05:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with scrape type 2
2026-03-28 05:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with scrape type 2
2026-03-28 05:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27e574e2-962c-5b6f-b0f1-ce629fe943b7, identifier: ZW22458
2026-03-28 05:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458
2026-03-28 05:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458
2026-03-28 05:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458 to the API
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:38:55Z',
 'fuel_type': 'petrol',
 'id': '27e574e2-962c-5b6f-b0f1-ce629fe943b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW22458',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 106309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-12',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2018}
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-28 05:37:05 [auto1.de] INFO: Saving data for ZW22458: {'auction_closing_time': 1774715935.0, 'created_time': 1774550419.867046, 'last_price_update_time': 1774676225.719634}
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW22458') HTTP/1.1" 204 0
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: YG55269
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: RH52660
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: XN01413
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: SL85430
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-28 05:37:05 [auto1.de] INFO: Scrape type for AJ18698: 0
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: AA89468
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA89468%27 HTTP/1.1" 200 None
2026-03-28 05:37:05 [auto1.de] INFO: Scrape type for AA89468: 0
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: BH73994
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: CK74950
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-28 05:37:05 [auto1.de] INFO: Scrape type for HP00850: 0
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: AB52853
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: KU59477
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-28 05:37:05 [auto1.de] INFO: Scrape type for XB46016: 2
2026-03-28 05:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016
2026-03-28 05:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84f96fd-058d-50a7-910f-d3b395067d18 with scrape type 2
2026-03-28 05:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f84f96fd-058d-50a7-910f-d3b395067d18 with scrape type 2
2026-03-28 05:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f84f96fd-058d-50a7-910f-d3b395067d18, identifier: XB46016
2026-03-28 05:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016
2026-03-28 05:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016
2026-03-28 05:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016 to the API
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:45:41Z',
 'fuel_type': 'diesel',
 'id': 'f84f96fd-058d-50a7-910f-d3b395067d18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB46016',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 238510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-11',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Saving data for XB46016: {'auction_closing_time': 1774716341.0, 'created_time': 1773916340.451143, 'last_price_update_time': 1774676226.203778}
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB46016') HTTP/1.1" 204 0
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: RW72684
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for YT16808: 2
2026-03-28 05:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808
2026-03-28 05:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with scrape type 2
2026-03-28 05:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with scrape type 2
2026-03-28 05:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1, identifier: YT16808
2026-03-28 05:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808
2026-03-28 05:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808
2026-03-28 05:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808 to the API
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:44:25Z',
 'fuel_type': 'diesel',
 'id': 'c54da2d6-baf8-5f1d-a15b-3027cc45c2d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT16808',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 121361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Saving data for YT16808: {'auction_closing_time': 1774716265.0, 'created_time': 1774552583.184309, 'last_price_update_time': 1774676226.751443}
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT16808') HTTP/1.1" 204 0
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: DM43280
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM43280%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for DM43280: 0
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for XM85964: 2
2026-03-28 05:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964
2026-03-28 05:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with scrape type 2
2026-03-28 05:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with scrape type 2
2026-03-28 05:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313, identifier: XM85964
2026-03-28 05:37:06 [scrapy.extensions.logstats] INFO: Crawled 132 pages (at 16 pages/min), scraped 492 items (at 76 items/min)
2026-03-28 05:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964
2026-03-28 05:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964
2026-03-28 05:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964 to the API
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:36:56Z',
 'fuel_type': 'petrol',
 'id': '5aa1c1e8-fc29-5b3a-8624-31a1592c0313',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM85964',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 142072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-12',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Saving data for XM85964: {'auction_closing_time': 1774715816.0, 'created_time': 1774550453.994882, 'last_price_update_time': 1774676227.252555}
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM85964') HTTP/1.1" 204 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Scrape type for GA42145: 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: MU10500
2026-03-28 05:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:08 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:08 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-28 05:37:08 [auto1.de] INFO: Scrape type for CY90259: 0
2026-03-28 05:37:08 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-28 05:37:08 [auto1.de] INFO: Found listing with ID: EZ01332
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ01332%27 HTTP/1.1" 200 None
2026-03-28 05:37:08 [auto1.de] INFO: Scrape type for EZ01332: 0
2026-03-28 05:37:08 [auto1.de] INFO: Found listing with ID: MJ74950
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ74950%27 HTTP/1.1" 200 None
2026-03-28 05:37:08 [auto1.de] INFO: Scrape type for MJ74950: 0
2026-03-28 05:37:08 [auto1.de] INFO: Found listing with ID: LM68672
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM68672%27 HTTP/1.1" 200 None
2026-03-28 05:37:08 [auto1.de] INFO: Scrape type for LM68672: 0
2026-03-28 05:37:08 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-28 05:37:08 [auto1.de] INFO: Scrape type for ZR25455: 0
2026-03-28 05:37:08 [auto1.de] INFO: Found listing with ID: ZS20777
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS20777%27 HTTP/1.1" 200 None
2026-03-28 05:37:08 [auto1.de] INFO: Scrape type for ZS20777: 0
2026-03-28 05:37:08 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-28 05:37:08 [auto1.de] INFO: Scrape type for VF40931: 2
2026-03-28 05:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84d7f332-a997-52c8-959b-d8896938f7e6 with identifier: VF40931
2026-03-28 05:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84d7f332-a997-52c8-959b-d8896938f7e6 with scrape type 2
2026-03-28 05:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84d7f332-a997-52c8-959b-d8896938f7e6 with scrape type 2
2026-03-28 05:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84d7f332-a997-52c8-959b-d8896938f7e6, identifier: VF40931
2026-03-28 05:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84d7f332-a997-52c8-959b-d8896938f7e6 with identifier: VF40931
2026-03-28 05:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84d7f332-a997-52c8-959b-d8896938f7e6 with identifier: VF40931
2026-03-28 05:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84d7f332-a997-52c8-959b-d8896938f7e6 with identifier: VF40931 to the API
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:00:55Z',
 'fuel_type': 'petrol',
 'id': '84d7f332-a997-52c8-959b-d8896938f7e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF40931',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 59314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'automatic',
 'trim': 'Stepway Prestige',
 'year': 2017}
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-28 05:37:08 [auto1.de] INFO: Saving data for VF40931: {'auction_closing_time': 1774713655.0, 'created_time': 1774552354.334995, 'last_price_update_time': 1774676228.59267}
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF40931') HTTP/1.1" 204 0
2026-03-28 05:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:08 [auto1.de] INFO: Found listing with ID: ZM93791
2026-03-28 05:37:08 [auto1.de] INFO: Found listing with ID: NY36854
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY36854%27 HTTP/1.1" 200 None
2026-03-28 05:37:08 [auto1.de] INFO: Scrape type for NY36854: 0
2026-03-28 05:37:08 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-28 05:37:08 [auto1.de] INFO: Scrape type for KG29776: 2
2026-03-28 05:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776
2026-03-28 05:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d079a9b2-1b71-51ff-b51c-3deea7ea11cf with scrape type 2
2026-03-28 05:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d079a9b2-1b71-51ff-b51c-3deea7ea11cf with scrape type 2
2026-03-28 05:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d079a9b2-1b71-51ff-b51c-3deea7ea11cf, identifier: KG29776
2026-03-28 05:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776
2026-03-28 05:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776
2026-03-28 05:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776 to the API
2026-03-28 05:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:33:18Z',
 'fuel_type': 'diesel',
 'id': 'd079a9b2-1b71-51ff-b51c-3deea7ea11cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG29776',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 125633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-09',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Saving data for KG29776: {'auction_closing_time': 1774715598.0, 'created_time': 1774552135.12405, 'last_price_update_time': 1774676229.13881}
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG29776') HTTP/1.1" 204 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: DC48587
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48587%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for DC48587: 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: KV44298
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: XM74841
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for JC18235: 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: GF12602
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: GH70383
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: DE53161
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE53161%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for DE53161: 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: KE44581
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: LE29079
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: NJ97251
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ97251%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for NJ97251: 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: GB19740
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19740%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for GB19740: 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: ZM05379
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM05379%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for ZM05379: 2
2026-03-28 05:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e5fc80-06ae-55a1-bd1e-4b005442055d with identifier: ZM05379
2026-03-28 05:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e5fc80-06ae-55a1-bd1e-4b005442055d with scrape type 2
2026-03-28 05:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7e5fc80-06ae-55a1-bd1e-4b005442055d with scrape type 2
2026-03-28 05:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7e5fc80-06ae-55a1-bd1e-4b005442055d, identifier: ZM05379
2026-03-28 05:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7e5fc80-06ae-55a1-bd1e-4b005442055d with identifier: ZM05379
2026-03-28 05:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7e5fc80-06ae-55a1-bd1e-4b005442055d with identifier: ZM05379
2026-03-28 05:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7e5fc80-06ae-55a1-bd1e-4b005442055d with identifier: ZM05379 to the API
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:54Z',
 'fuel_type': 'petrol',
 'id': 'a7e5fc80-06ae-55a1-bd1e-4b005442055d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM05379',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 182930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-10',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM05379%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Saving data for ZM05379: {'auction_closing_time': 1774714314.0, 'created_time': 1774467684.227313, 'last_price_update_time': 1774676229.66362}
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM05379') HTTP/1.1" 204 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: WM92411
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for NT04254: 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: PE04478
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: EL74738
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL74738%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for EL74738: 2
2026-03-28 05:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2a6fcc1-efdb-5289-a6b0-3e5ba602f2f7 with identifier: EL74738
2026-03-28 05:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a6fcc1-efdb-5289-a6b0-3e5ba602f2f7 with scrape type 2
2026-03-28 05:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2a6fcc1-efdb-5289-a6b0-3e5ba602f2f7 with scrape type 2
2026-03-28 05:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2a6fcc1-efdb-5289-a6b0-3e5ba602f2f7, identifier: EL74738
2026-03-28 05:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2a6fcc1-efdb-5289-a6b0-3e5ba602f2f7 with identifier: EL74738
2026-03-28 05:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2a6fcc1-efdb-5289-a6b0-3e5ba602f2f7 with identifier: EL74738
2026-03-28 05:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2a6fcc1-efdb-5289-a6b0-3e5ba602f2f7 with identifier: EL74738 to the API
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:57:55Z',
 'fuel_type': 'diesel',
 'id': 'a2a6fcc1-efdb-5289-a6b0-3e5ba602f2f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL74738',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 169149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-02',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet My Freemont',
 'transmission': 'manual',
 'trim': 'My',
 'year': 2015}
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL74738%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Saving data for EL74738: {'auction_closing_time': 1774717075.0, 'created_time': 1773225592.004588, 'last_price_update_time': 1774676230.222594}
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL74738') HTTP/1.1" 204 0
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Scrape type for UH34905: 0
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: LS45558
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: GW29634
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW29634%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Scrape type for GW29634: 0
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Scrape type for MT90802: 2
2026-03-28 05:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802
2026-03-28 05:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e54dd4-b604-5ebe-ba17-f51f182b21dc with scrape type 2
2026-03-28 05:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83e54dd4-b604-5ebe-ba17-f51f182b21dc with scrape type 2
2026-03-28 05:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83e54dd4-b604-5ebe-ba17-f51f182b21dc, identifier: MT90802
2026-03-28 05:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802
2026-03-28 05:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802
2026-03-28 05:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802 to the API
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:24:02Z',
 'fuel_type': 'petrol',
 'id': '83e54dd4-b604-5ebe-ba17-f51f182b21dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT90802',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 259410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2012}
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Saving data for MT90802: {'auction_closing_time': 1774715042.0, 'created_time': 1774552730.077489, 'last_price_update_time': 1774676230.725637}
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT90802') HTTP/1.1" 204 0
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: DW74206
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: SG73532
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG73532%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Scrape type for SG73532: 0
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: PP35153
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: WY46685
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY46685%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Scrape type for WY46685: 0
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-28 05:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:11 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: SZ79532
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA14151%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Scrape type for CA14151: 0
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: XS36937
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: DH78360
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: KX36775
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: JM32956
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: RR06501
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR06501%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Scrape type for RR06501: 0
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: GJ44071
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: RP55300
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Scrape type for SN98432: 2
2026-03-28 05:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37ed52b-2a77-59c7-bd58-602c8906cd87 with identifier: SN98432
2026-03-28 05:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37ed52b-2a77-59c7-bd58-602c8906cd87 with scrape type 2
2026-03-28 05:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e37ed52b-2a77-59c7-bd58-602c8906cd87 with scrape type 2
2026-03-28 05:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e37ed52b-2a77-59c7-bd58-602c8906cd87, identifier: SN98432
2026-03-28 05:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e37ed52b-2a77-59c7-bd58-602c8906cd87 with identifier: SN98432
2026-03-28 05:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e37ed52b-2a77-59c7-bd58-602c8906cd87 with identifier: SN98432
2026-03-28 05:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e37ed52b-2a77-59c7-bd58-602c8906cd87 with identifier: SN98432 to the API
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:03:16Z',
 'fuel_type': 'petrol',
 'id': 'e37ed52b-2a77-59c7-bd58-602c8906cd87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN98432',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 172539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-24',
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-28 05:37:12 [auto1.de] INFO: Saving data for SN98432: {'auction_closing_time': 1774713796.0, 'created_time': 1774550989.250711, 'last_price_update_time': 1774676232.104181}
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN98432') HTTP/1.1" 204 0
2026-03-28 05:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: YR53250
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR53250%27 HTTP/1.1" 200 None
2026-03-28 05:37:12 [auto1.de] INFO: Scrape type for YR53250: 2
2026-03-28 05:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e387b3-e57a-588c-a9e3-6b18ce566e22 with identifier: YR53250
2026-03-28 05:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e387b3-e57a-588c-a9e3-6b18ce566e22 with scrape type 2
2026-03-28 05:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57e387b3-e57a-588c-a9e3-6b18ce566e22 with scrape type 2
2026-03-28 05:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57e387b3-e57a-588c-a9e3-6b18ce566e22, identifier: YR53250
2026-03-28 05:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57e387b3-e57a-588c-a9e3-6b18ce566e22 with identifier: YR53250
2026-03-28 05:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57e387b3-e57a-588c-a9e3-6b18ce566e22 with identifier: YR53250
2026-03-28 05:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57e387b3-e57a-588c-a9e3-6b18ce566e22 with identifier: YR53250 to the API
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:09:01Z',
 'fuel_type': 'diesel',
 'id': '57e387b3-e57a-588c-a9e3-6b18ce566e22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR53250',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 271776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-16',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR53250%27 HTTP/1.1" 200 None
2026-03-28 05:37:12 [auto1.de] INFO: Saving data for YR53250: {'auction_closing_time': 1774714141.0, 'created_time': 1774503048.548944, 'last_price_update_time': 1774676232.666632}
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR53250') HTTP/1.1" 204 0
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: JM90464
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM90464%27 HTTP/1.1" 200 None
2026-03-28 05:37:12 [auto1.de] INFO: Scrape type for JM90464: 0
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: AJ98197
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-28 05:37:12 [auto1.de] INFO: Scrape type for VH36335: 0
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA47632%27 HTTP/1.1" 200 None
2026-03-28 05:37:12 [auto1.de] INFO: Scrape type for MA47632: 0
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: YU90808
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU90808%27 HTTP/1.1" 200 None
2026-03-28 05:37:12 [auto1.de] INFO: Scrape type for YU90808: 0
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-28 05:37:12 [auto1.de] INFO: Scrape type for RS09713: 0
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: NE09834
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: XU78449
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-28 05:37:12 [auto1.de] INFO: Scrape type for GR47170: 0
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: WG42712
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-28 05:37:12 [auto1.de] INFO: Found listing with ID: FD43857
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD43857%27 HTTP/1.1" 200 None
2026-03-28 05:37:12 [auto1.de] INFO: Scrape type for FD43857: 2
2026-03-28 05:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad80eb24-0aa7-5fb5-bb4a-c7cddc55af27 with identifier: FD43857
2026-03-28 05:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad80eb24-0aa7-5fb5-bb4a-c7cddc55af27 with scrape type 2
2026-03-28 05:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad80eb24-0aa7-5fb5-bb4a-c7cddc55af27 with scrape type 2
2026-03-28 05:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad80eb24-0aa7-5fb5-bb4a-c7cddc55af27, identifier: FD43857
2026-03-28 05:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad80eb24-0aa7-5fb5-bb4a-c7cddc55af27 with identifier: FD43857
2026-03-28 05:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad80eb24-0aa7-5fb5-bb4a-c7cddc55af27 with identifier: FD43857
2026-03-28 05:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad80eb24-0aa7-5fb5-bb4a-c7cddc55af27 with identifier: FD43857 to the API
2026-03-28 05:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:46:04Z',
 'fuel_type': 'petrol',
 'id': 'ad80eb24-0aa7-5fb5-bb4a-c7cddc55af27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD43857',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 140985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-09',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8 Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 1999}
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD43857%27 HTTP/1.1" 200 None
2026-03-28 05:37:13 [auto1.de] INFO: Saving data for FD43857: {'auction_closing_time': 1774716364.0, 'created_time': 1774467897.833342, 'last_price_update_time': 1774676233.208388}
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD43857') HTTP/1.1" 204 0
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: UR23354
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR23354%27 HTTP/1.1" 200 None
2026-03-28 05:37:13 [auto1.de] INFO: Scrape type for UR23354: 0
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: UX96397
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: MD28081
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: HH37576
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: NX83619
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83619%27 HTTP/1.1" 200 None
2026-03-28 05:37:13 [auto1.de] INFO: Scrape type for NX83619: 2
2026-03-28 05:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d7ec987-55aa-5e82-8eb5-213e5945f675 with identifier: NX83619
2026-03-28 05:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7ec987-55aa-5e82-8eb5-213e5945f675 with scrape type 2
2026-03-28 05:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d7ec987-55aa-5e82-8eb5-213e5945f675 with scrape type 2
2026-03-28 05:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d7ec987-55aa-5e82-8eb5-213e5945f675, identifier: NX83619
2026-03-28 05:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d7ec987-55aa-5e82-8eb5-213e5945f675 with identifier: NX83619
2026-03-28 05:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d7ec987-55aa-5e82-8eb5-213e5945f675 with identifier: NX83619
2026-03-28 05:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d7ec987-55aa-5e82-8eb5-213e5945f675 with identifier: NX83619 to the API
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:24Z',
 'fuel_type': 'petrol',
 'id': '0d7ec987-55aa-5e82-8eb5-213e5945f675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX83619',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 158022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-21',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Sync Edition',
 'transmission': 'manual',
 'trim': 'Sync Edition',
 'year': 2014}
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83619%27 HTTP/1.1" 200 None
2026-03-28 05:37:13 [auto1.de] INFO: Saving data for NX83619: {'auction_closing_time': 1774713624.0, 'created_time': 1774552848.556746, 'last_price_update_time': 1774676233.763548}
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX83619') HTTP/1.1" 204 0
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: WE84338
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE84338%27 HTTP/1.1" 200 None
2026-03-28 05:37:13 [auto1.de] INFO: Scrape type for WE84338: 0
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: FA30463
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-28 05:37:13 [auto1.de] INFO: Scrape type for SM51050: 0
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: WZ70999
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ70999%27 HTTP/1.1" 200 None
2026-03-28 05:37:13 [auto1.de] INFO: Scrape type for WZ70999: 0
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: KX20208
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: BS12616
2026-03-28 05:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:14 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: DM53620
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM53620%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for DM53620: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: HY95420
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: WT92496
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: SK78109
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK78109%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for SK78109: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: PJ80384
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ80384%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for PJ80384: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: BR45511
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR45511%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for BR45511: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for GU64592: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: TS77331
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS77331%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for TS77331: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: RK36338
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: SE81381
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE81381%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for SE81381: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: TW05114
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05114%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for TW05114: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: BH71289
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH71289%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for BH71289: 2
2026-03-28 05:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd4544c6-0c15-5018-af9d-5fbf1cf66721 with identifier: BH71289
2026-03-28 05:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd4544c6-0c15-5018-af9d-5fbf1cf66721 with scrape type 2
2026-03-28 05:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd4544c6-0c15-5018-af9d-5fbf1cf66721 with scrape type 2
2026-03-28 05:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd4544c6-0c15-5018-af9d-5fbf1cf66721, identifier: BH71289
2026-03-28 05:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd4544c6-0c15-5018-af9d-5fbf1cf66721 with identifier: BH71289
2026-03-28 05:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd4544c6-0c15-5018-af9d-5fbf1cf66721 with identifier: BH71289
2026-03-28 05:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd4544c6-0c15-5018-af9d-5fbf1cf66721 with identifier: BH71289 to the API
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:55:38Z',
 'fuel_type': 'diesel',
 'id': 'fd4544c6-0c15-5018-af9d-5fbf1cf66721',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH71289',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 253559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-06',
 'seller_name': None,
 'title': 'Volvo V50 1.6 D2 Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2011}
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH71289%27 HTTP/1.1" 200 None
2026-03-28 05:37:15 [auto1.de] INFO: Saving data for BH71289: {'auction_closing_time': 1774716938.0, 'created_time': 1773224717.527461, 'last_price_update_time': 1774676235.18749}
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH71289') HTTP/1.1" 204 0
2026-03-28 05:37:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:15 [auto1.de] INFO: Found listing with ID: VP41401
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP41401%27 HTTP/1.1" 200 None
2026-03-28 05:37:15 [auto1.de] INFO: Scrape type for VP41401: 0
2026-03-28 05:37:15 [auto1.de] INFO: Found listing with ID: RB35490
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB35490%27 HTTP/1.1" 200 None
2026-03-28 05:37:15 [auto1.de] INFO: Scrape type for RB35490: 0
2026-03-28 05:37:15 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-28 05:37:15 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-28 05:37:15 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN68791%27 HTTP/1.1" 200 None
2026-03-28 05:37:15 [auto1.de] INFO: Scrape type for AN68791: 0
2026-03-28 05:37:15 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-28 05:37:15 [auto1.de] INFO: Scrape type for UA00536: 2
2026-03-28 05:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536
2026-03-28 05:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61f77df8-94bc-50ac-a637-eff6158e3057 with scrape type 2
2026-03-28 05:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61f77df8-94bc-50ac-a637-eff6158e3057 with scrape type 2
2026-03-28 05:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61f77df8-94bc-50ac-a637-eff6158e3057, identifier: UA00536
2026-03-28 05:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536
2026-03-28 05:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536
2026-03-28 05:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536 to the API
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:26:55Z',
 'fuel_type': 'petrol',
 'id': '61f77df8-94bc-50ac-a637-eff6158e3057',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA00536',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 120819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-28',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-28 05:37:15 [auto1.de] INFO: Saving data for UA00536: {'auction_closing_time': 1774715215.0, 'created_time': 1774552439.39108, 'last_price_update_time': 1774676235.761659}
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA00536') HTTP/1.1" 204 0
2026-03-28 05:37:15 [auto1.de] INFO: Found listing with ID: US80699
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US80699%27 HTTP/1.1" 200 None
2026-03-28 05:37:15 [auto1.de] INFO: Scrape type for US80699: 0
2026-03-28 05:37:15 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-28 05:37:15 [auto1.de] INFO: Scrape type for JF12446: 2
2026-03-28 05:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446
2026-03-28 05:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e14b3722-6251-5e9d-9634-9e562d472e6d with scrape type 2
2026-03-28 05:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e14b3722-6251-5e9d-9634-9e562d472e6d with scrape type 2
2026-03-28 05:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e14b3722-6251-5e9d-9634-9e562d472e6d, identifier: JF12446
2026-03-28 05:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446
2026-03-28 05:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446
2026-03-28 05:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446 to the API
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:13:33Z',
 'fuel_type': 'petrol',
 'id': 'e14b3722-6251-5e9d-9634-9e562d472e6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF12446',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 111161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-18',
 'seller_name': None,
 'title': 'Nissan Note 1.6 I-Way',
 'transmission': 'manual',
 'trim': 'I-Way',
 'year': 2012}
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-28 05:37:16 [auto1.de] INFO: Saving data for JF12446: {'auction_closing_time': 1774714413.0, 'created_time': 1773341018.13113, 'last_price_update_time': 1774676236.24634}
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF12446') HTTP/1.1" 204 0
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: GB62942
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: LL54952
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: DU80644
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: YG98793
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: ZN92027
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: HG78965
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG78965%27 HTTP/1.1" 200 None
2026-03-28 05:37:16 [auto1.de] INFO: Scrape type for HG78965: 0
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: UH62107
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH62107%27 HTTP/1.1" 200 None
2026-03-28 05:37:16 [auto1.de] INFO: Scrape type for UH62107: 0
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: AT99674
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-28 05:37:16 [auto1.de] INFO: Scrape type for EC44311: 2
2026-03-28 05:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 267bab6c-3fd3-569f-8c88-4983414091f9 with identifier: EC44311
2026-03-28 05:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 267bab6c-3fd3-569f-8c88-4983414091f9 with scrape type 2
2026-03-28 05:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 267bab6c-3fd3-569f-8c88-4983414091f9 with scrape type 2
2026-03-28 05:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 267bab6c-3fd3-569f-8c88-4983414091f9, identifier: EC44311
2026-03-28 05:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 267bab6c-3fd3-569f-8c88-4983414091f9 with identifier: EC44311
2026-03-28 05:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 267bab6c-3fd3-569f-8c88-4983414091f9 with identifier: EC44311
2026-03-28 05:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 267bab6c-3fd3-569f-8c88-4983414091f9 with identifier: EC44311 to the API
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:01:19Z',
 'fuel_type': 'petrol',
 'id': '267bab6c-3fd3-569f-8c88-4983414091f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC44311',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 42584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-14',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2023}
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-28 05:37:16 [auto1.de] INFO: Saving data for EC44311: {'auction_closing_time': 1774713679.0, 'created_time': 1774589445.905279, 'last_price_update_time': 1774676236.713445}
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC44311') HTTP/1.1" 204 0
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: DE48609
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE48609%27 HTTP/1.1" 200 None
2026-03-28 05:37:16 [auto1.de] INFO: Scrape type for DE48609: 0
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: WG52283
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52283%27 HTTP/1.1" 200 None
2026-03-28 05:37:16 [auto1.de] INFO: Scrape type for WG52283: 0
2026-03-28 05:37:16 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-28 05:37:16 [auto1.de] INFO: Scrape type for UY95441: 2
2026-03-28 05:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441
2026-03-28 05:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with scrape type 2
2026-03-28 05:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with scrape type 2
2026-03-28 05:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2, identifier: UY95441
2026-03-28 05:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441
2026-03-28 05:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441
2026-03-28 05:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441 to the API
2026-03-28 05:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:37:54Z',
 'fuel_type': 'petrol',
 'id': '3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY95441',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 137738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-12',
 'seller_name': None,
 'title': 'Toyota Corolla 1.6 Compact Sol',
 'transmission': 'manual',
 'trim': 'Compact Sol',
 'year': 2005}
2026-03-28 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-28 05:37:17 [auto1.de] INFO: Saving data for UY95441: {'auction_closing_time': 1774715874.0, 'created_time': 1773916862.210946, 'last_price_update_time': 1774676237.282742}
2026-03-28 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY95441') HTTP/1.1" 204 0
2026-03-28 05:37:17 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-28 05:37:17 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-28 05:37:17 [auto1.de] INFO: Found listing with ID: DZ26668
2026-03-28 05:37:17 [auto1.de] INFO: Found listing with ID: PP69489
2026-03-28 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP69489%27 HTTP/1.1" 200 None
2026-03-28 05:37:17 [auto1.de] INFO: Scrape type for PP69489: 0
2026-03-28 05:37:17 [auto1.de] INFO: Found listing with ID: FX85164
2026-03-28 05:37:17 [auto1.de] INFO: Found listing with ID: MD91791
2026-03-28 05:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:22 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: WE14198
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE14198%27 HTTP/1.1" 200 None
2026-03-28 05:37:22 [auto1.de] INFO: Scrape type for WE14198: 0
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: BX93358
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT46739%27 HTTP/1.1" 200 None
2026-03-28 05:37:22 [auto1.de] INFO: Scrape type for LT46739: 0
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: BF99828
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF99828%27 HTTP/1.1" 200 None
2026-03-28 05:37:22 [auto1.de] INFO: Scrape type for BF99828: 0
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: VU57107
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU57107%27 HTTP/1.1" 200 None
2026-03-28 05:37:22 [auto1.de] INFO: Scrape type for VU57107: 0
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: KD44846
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD44846%27 HTTP/1.1" 200 None
2026-03-28 05:37:22 [auto1.de] INFO: Scrape type for KD44846: 0
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-28 05:37:22 [auto1.de] INFO: Scrape type for BR96483: 2
2026-03-28 05:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483
2026-03-28 05:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with scrape type 2
2026-03-28 05:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with scrape type 2
2026-03-28 05:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8, identifier: BR96483
2026-03-28 05:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483
2026-03-28 05:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483
2026-03-28 05:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483 to the API
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:27:25Z',
 'fuel_type': 'diesel',
 'id': 'e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR96483',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 266856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-18',
 'seller_name': None,
 'title': 'Audi Q5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-28 05:37:22 [auto1.de] INFO: Saving data for BR96483: {'auction_closing_time': 1774715245.0, 'created_time': 1774552676.760561, 'last_price_update_time': 1774676242.644153}
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR96483') HTTP/1.1" 204 0
2026-03-28 05:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: KP26466
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-28 05:37:22 [auto1.de] INFO: Scrape type for KW72669: 2
2026-03-28 05:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f763cab5-8f32-58ef-8fc1-f9ae77ae991f with identifier: KW72669
2026-03-28 05:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f763cab5-8f32-58ef-8fc1-f9ae77ae991f with scrape type 2
2026-03-28 05:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f763cab5-8f32-58ef-8fc1-f9ae77ae991f with scrape type 2
2026-03-28 05:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f763cab5-8f32-58ef-8fc1-f9ae77ae991f, identifier: KW72669
2026-03-28 05:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f763cab5-8f32-58ef-8fc1-f9ae77ae991f with identifier: KW72669
2026-03-28 05:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f763cab5-8f32-58ef-8fc1-f9ae77ae991f with identifier: KW72669
2026-03-28 05:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f763cab5-8f32-58ef-8fc1-f9ae77ae991f with identifier: KW72669 to the API
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:12:20Z',
 'fuel_type': 'diesel',
 'id': 'f763cab5-8f32-58ef-8fc1-f9ae77ae991f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW72669',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 170592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi Tekna 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna 4x4',
 'year': 2017}
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Saving data for KW72669: {'auction_closing_time': 1774714340.0, 'created_time': 1774436000.599067, 'last_price_update_time': 1774676243.193062}
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW72669') HTTP/1.1" 204 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: TM93918
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM93918%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for TM93918: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for HG94589: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: UH39337
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH39337%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for UH39337: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: VF58468
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF58468%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for VF58468: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: GN34545
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN34545%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for GN34545: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: AX05143
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05143%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for AX05143: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: GR51738
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR51738%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for GR51738: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for JS64432: 2
2026-03-28 05:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432
2026-03-28 05:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd7fab7d-aa15-552a-9ec9-f89955258a3c with scrape type 2
2026-03-28 05:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd7fab7d-aa15-552a-9ec9-f89955258a3c with scrape type 2
2026-03-28 05:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd7fab7d-aa15-552a-9ec9-f89955258a3c, identifier: JS64432
2026-03-28 05:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432
2026-03-28 05:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432
2026-03-28 05:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432 to the API
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:51:47Z',
 'fuel_type': 'petrol',
 'id': 'cd7fab7d-aa15-552a-9ec9-f89955258a3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS64432',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 122190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-28',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Saving data for JS64432: {'auction_closing_time': 1774716707.0, 'created_time': 1774552165.266365, 'last_price_update_time': 1774676243.77416}
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS64432') HTTP/1.1" 204 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU84960%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for YU84960: 2
2026-03-28 05:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960
2026-03-28 05:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c85bd486-6eca-5f3d-bd48-344382cca67e with scrape type 2
2026-03-28 05:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c85bd486-6eca-5f3d-bd48-344382cca67e with scrape type 2
2026-03-28 05:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c85bd486-6eca-5f3d-bd48-344382cca67e, identifier: YU84960
2026-03-28 05:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960
2026-03-28 05:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960
2026-03-28 05:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960 to the API
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:30:24Z',
 'fuel_type': 'diesel',
 'id': 'c85bd486-6eca-5f3d-bd48-344382cca67e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU84960',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 121182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-26',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi BOSE Edition',
 'transmission': 'automatic',
 'trim': 'BOSE Edition',
 'year': 2014}
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU84960%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Saving data for YU84960: {'auction_closing_time': 1774715424.0, 'created_time': 1773307909.355575, 'last_price_update_time': 1774676244.317983}
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU84960') HTTP/1.1" 204 0
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Scrape type for BV96040: 2
2026-03-28 05:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with identifier: BV96040
2026-03-28 05:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with scrape type 2
2026-03-28 05:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with scrape type 2
2026-03-28 05:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5eb7ac6-9dda-53b0-9a08-d670731fe7e5, identifier: BV96040
2026-03-28 05:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with identifier: BV96040
2026-03-28 05:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with identifier: BV96040
2026-03-28 05:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with identifier: BV96040 to the API
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:18Z',
 'fuel_type': 'petrol',
 'id': 'c5eb7ac6-9dda-53b0-9a08-d670731fe7e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV96040',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 21326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-25',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2023}
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Saving data for BV96040: {'auction_closing_time': 1774714578.0, 'created_time': 1774551058.868757, 'last_price_update_time': 1774676244.750543}
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV96040') HTTP/1.1" 204 0
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: NV66174
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV66174%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Scrape type for NV66174: 0
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: SP32768
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP32768%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Scrape type for SP32768: 0
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: BG47316
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: TE51742
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: BU31051
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: RG99680
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: AX75874
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX75874%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Scrape type for AX75874: 0
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: GS24649
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: RS08220
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS08220%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Scrape type for RS08220: 0
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Scrape type for RL20580: 2
2026-03-28 05:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with identifier: RL20580
2026-03-28 05:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with scrape type 2
2026-03-28 05:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with scrape type 2
2026-03-28 05:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c, identifier: RL20580
2026-03-28 05:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with identifier: RL20580
2026-03-28 05:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with identifier: RL20580
2026-03-28 05:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with identifier: RL20580 to the API
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:08:22Z',
 'fuel_type': 'petrol',
 'id': '3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL20580',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 107218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-01',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2015}
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-28 05:37:25 [auto1.de] INFO: Saving data for RL20580: {'auction_closing_time': 1774714102.0, 'created_time': 1774552826.236594, 'last_price_update_time': 1774676245.239251}
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL20580') HTTP/1.1" 204 0
2026-03-28 05:37:25 [auto1.de] INFO: Found listing with ID: LZ64363
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ64363%27 HTTP/1.1" 200 None
2026-03-28 05:37:25 [auto1.de] INFO: Scrape type for LZ64363: 0
2026-03-28 05:37:25 [auto1.de] INFO: Found listing with ID: NA10756
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA10756%27 HTTP/1.1" 200 None
2026-03-28 05:37:25 [auto1.de] INFO: Scrape type for NA10756: 2
2026-03-28 05:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a06dfd94-1b34-5c29-ab8a-7ac483aece60 with identifier: NA10756
2026-03-28 05:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a06dfd94-1b34-5c29-ab8a-7ac483aece60 with scrape type 2
2026-03-28 05:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a06dfd94-1b34-5c29-ab8a-7ac483aece60 with scrape type 2
2026-03-28 05:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a06dfd94-1b34-5c29-ab8a-7ac483aece60, identifier: NA10756
2026-03-28 05:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a06dfd94-1b34-5c29-ab8a-7ac483aece60 with identifier: NA10756
2026-03-28 05:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a06dfd94-1b34-5c29-ab8a-7ac483aece60 with identifier: NA10756
2026-03-28 05:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a06dfd94-1b34-5c29-ab8a-7ac483aece60 with identifier: NA10756 to the API
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:28:38Z',
 'fuel_type': 'petrol',
 'id': 'a06dfd94-1b34-5c29-ab8a-7ac483aece60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA10756',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 147589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Unlimited',
 'transmission': 'manual',
 'trim': 'Unlimited',
 'year': 2018}
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA10756%27 HTTP/1.1" 200 None
2026-03-28 05:37:25 [auto1.de] INFO: Saving data for NA10756: {'auction_closing_time': 1774715318.0, 'created_time': 1774466873.09724, 'last_price_update_time': 1774676245.775633}
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA10756') HTTP/1.1" 204 0
2026-03-28 05:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:26 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: VA23337
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA23337%27 HTTP/1.1" 200 None
2026-03-28 05:37:26 [auto1.de] INFO: Scrape type for VA23337: 0
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: ED87662
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: ZT91138
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT91138%27 HTTP/1.1" 200 None
2026-03-28 05:37:26 [auto1.de] INFO: Scrape type for ZT91138: 0
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: BR62242
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: ND31519
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: WS70576
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS70576%27 HTTP/1.1" 200 None
2026-03-28 05:37:26 [auto1.de] INFO: Scrape type for WS70576: 2
2026-03-28 05:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da388176-23a0-547e-9ce2-27c52d55b928 with identifier: WS70576
2026-03-28 05:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da388176-23a0-547e-9ce2-27c52d55b928 with scrape type 2
2026-03-28 05:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da388176-23a0-547e-9ce2-27c52d55b928 with scrape type 2
2026-03-28 05:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da388176-23a0-547e-9ce2-27c52d55b928, identifier: WS70576
2026-03-28 05:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da388176-23a0-547e-9ce2-27c52d55b928 with identifier: WS70576
2026-03-28 05:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da388176-23a0-547e-9ce2-27c52d55b928 with identifier: WS70576
2026-03-28 05:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da388176-23a0-547e-9ce2-27c52d55b928 with identifier: WS70576 to the API
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:25:23Z',
 'fuel_type': 'petrol',
 'id': 'da388176-23a0-547e-9ce2-27c52d55b928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS70576',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 101585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-15',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2020}
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS70576%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Saving data for WS70576: {'auction_closing_time': 1774715123.0, 'created_time': 1774467422.888416, 'last_price_update_time': 1774676247.087613}
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS70576') HTTP/1.1" 204 0
2026-03-28 05:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: MU06950
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55268%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for HT55268: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for EL91395: 2
2026-03-28 05:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395
2026-03-28 05:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c25ffd9d-22a1-58fc-ac48-e6acaac22652 with scrape type 2
2026-03-28 05:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c25ffd9d-22a1-58fc-ac48-e6acaac22652 with scrape type 2
2026-03-28 05:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c25ffd9d-22a1-58fc-ac48-e6acaac22652, identifier: EL91395
2026-03-28 05:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395
2026-03-28 05:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395
2026-03-28 05:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395 to the API
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:41:54Z',
 'fuel_type': 'petrol',
 'id': 'c25ffd9d-22a1-58fc-ac48-e6acaac22652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL91395',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 101206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-12',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Spirit",
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2016}
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Saving data for EL91395: {'auction_closing_time': 1774716114.0, 'created_time': 1774550835.454221, 'last_price_update_time': 1774676247.542174}
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL91395') HTTP/1.1" 204 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: GL43025
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: LR55805
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR55805%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for LR55805: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: CG60356
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: NC69837
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC69837%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for NC69837: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR76399%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for CR76399: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: WK00710
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK00710%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for WK00710: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for LT87510: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: BV90927
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: LD74655
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD74655%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for LD74655: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: AU29574
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: LM65356
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM65356%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for LM65356: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: LE59540
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE59540%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for LE59540: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for CM68518: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: KJ04555
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: PR68171
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: GA84874
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: NH48302
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48302%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for NH48302: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: FU90686
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: VZ82726
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ82726%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for VZ82726: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: CS72322
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS72322%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for CS72322: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: ZR98905
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: JN87452
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: EZ97284
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ97284%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for EZ97284: 0
2026-03-28 05:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:38 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:38 [auto1.de] INFO: Found listing with ID: SJ63843
2026-03-28 05:37:38 [auto1.de] INFO: Found listing with ID: VZ68210
2026-03-28 05:37:38 [auto1.de] INFO: Found listing with ID: PM53589
2026-03-28 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM53589%27 HTTP/1.1" 200 None
2026-03-28 05:37:38 [auto1.de] INFO: Scrape type for PM53589: 2
2026-03-28 05:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e51e7547-605b-54d9-a992-412a965337b8 with identifier: PM53589
2026-03-28 05:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e51e7547-605b-54d9-a992-412a965337b8 with scrape type 2
2026-03-28 05:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e51e7547-605b-54d9-a992-412a965337b8 with scrape type 2
2026-03-28 05:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e51e7547-605b-54d9-a992-412a965337b8, identifier: PM53589
2026-03-28 05:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e51e7547-605b-54d9-a992-412a965337b8 with identifier: PM53589
2026-03-28 05:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e51e7547-605b-54d9-a992-412a965337b8 with identifier: PM53589
2026-03-28 05:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e51e7547-605b-54d9-a992-412a965337b8 with identifier: PM53589 to the API
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:17:51Z',
 'fuel_type': 'petrol',
 'id': 'e51e7547-605b-54d9-a992-412a965337b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM53589',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 29450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM53589%27 HTTP/1.1" 200 None
2026-03-28 05:37:39 [auto1.de] INFO: Saving data for PM53589: {'auction_closing_time': 1774714671.0, 'created_time': 1774467797.551694, 'last_price_update_time': 1774676259.287813}
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM53589') HTTP/1.1" 204 0
2026-03-28 05:37:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-28 05:37:39 [auto1.de] INFO: Scrape type for MP93113: 0
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-28 05:37:39 [auto1.de] INFO: Scrape type for VX98591: 0
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: GM26241
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: RE64709
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE64709%27 HTTP/1.1" 200 None
2026-03-28 05:37:39 [auto1.de] INFO: Scrape type for RE64709: 0
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: AJ85429
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85429%27 HTTP/1.1" 200 None
2026-03-28 05:37:39 [auto1.de] INFO: Scrape type for AJ85429: 0
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: LH84474
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: DE92254
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE92254%27 HTTP/1.1" 200 None
2026-03-28 05:37:39 [auto1.de] INFO: Scrape type for DE92254: 0
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: CL77632
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: PJ34176
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34176%27 HTTP/1.1" 200 None
2026-03-28 05:37:39 [auto1.de] INFO: Scrape type for PJ34176: 0
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: GA94662
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: CT29846
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT29846%27 HTTP/1.1" 200 None
2026-03-28 05:37:39 [auto1.de] INFO: Scrape type for CT29846: 0
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: PM22977
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM22977%27 HTTP/1.1" 200 None
2026-03-28 05:37:39 [auto1.de] INFO: Scrape type for PM22977: 0
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-28 05:37:39 [auto1.de] INFO: Found listing with ID: ED27900
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED27900%27 HTTP/1.1" 200 None
2026-03-28 05:37:39 [auto1.de] INFO: Scrape type for ED27900: 2
2026-03-28 05:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58745fc9-4994-562d-98cd-48cf61c50d8f with identifier: ED27900
2026-03-28 05:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58745fc9-4994-562d-98cd-48cf61c50d8f with scrape type 2
2026-03-28 05:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58745fc9-4994-562d-98cd-48cf61c50d8f with scrape type 2
2026-03-28 05:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58745fc9-4994-562d-98cd-48cf61c50d8f, identifier: ED27900
2026-03-28 05:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58745fc9-4994-562d-98cd-48cf61c50d8f with identifier: ED27900
2026-03-28 05:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58745fc9-4994-562d-98cd-48cf61c50d8f with identifier: ED27900
2026-03-28 05:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58745fc9-4994-562d-98cd-48cf61c50d8f with identifier: ED27900 to the API
2026-03-28 05:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:02Z',
 'fuel_type': 'diesel',
 'id': '58745fc9-4994-562d-98cd-48cf61c50d8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED27900',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 157128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-12',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI clean diesel S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket plus',
 'year': 2015}
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED27900%27 HTTP/1.1" 200 None
2026-03-28 05:37:40 [auto1.de] INFO: Saving data for ED27900: {'auction_closing_time': 1774716362.0, 'created_time': 1773228976.847541, 'last_price_update_time': 1774676260.350948}
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED27900') HTTP/1.1" 204 0
2026-03-28 05:37:40 [auto1.de] INFO: Found listing with ID: XW75197
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW75197%27 HTTP/1.1" 200 None
2026-03-28 05:37:40 [auto1.de] INFO: Scrape type for XW75197: 0
2026-03-28 05:37:40 [auto1.de] INFO: Found listing with ID: LA89414
2026-03-28 05:37:40 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-28 05:37:40 [auto1.de] INFO: Scrape type for LJ68235: 0
2026-03-28 05:37:40 [auto1.de] INFO: Found listing with ID: VW14529
2026-03-28 05:37:40 [auto1.de] INFO: Found listing with ID: MV76572
2026-03-28 05:37:40 [auto1.de] INFO: Found listing with ID: KY77386
2026-03-28 05:37:40 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-28 05:37:40 [auto1.de] INFO: Scrape type for JS34798: 0
2026-03-28 05:37:40 [auto1.de] INFO: Found listing with ID: HE06850
2026-03-28 05:37:40 [auto1.de] INFO: Found listing with ID: RU20200
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU20200%27 HTTP/1.1" 200 None
2026-03-28 05:37:40 [auto1.de] INFO: Scrape type for RU20200: 0
2026-03-28 05:37:40 [auto1.de] INFO: Found listing with ID: PW87912
2026-03-28 05:37:40 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-28 05:37:40 [auto1.de] INFO: Scrape type for CS57817: 2
2026-03-28 05:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817
2026-03-28 05:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b023d71d-53b9-5e8f-a193-0eaa1d56b699 with scrape type 2
2026-03-28 05:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b023d71d-53b9-5e8f-a193-0eaa1d56b699 with scrape type 2
2026-03-28 05:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b023d71d-53b9-5e8f-a193-0eaa1d56b699, identifier: CS57817
2026-03-28 05:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817
2026-03-28 05:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817
2026-03-28 05:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817 to the API
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:34:12Z',
 'fuel_type': 'petrol',
 'id': 'b023d71d-53b9-5e8f-a193-0eaa1d56b699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS57817',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 158560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-28 05:37:40 [auto1.de] INFO: Saving data for CS57817: {'auction_closing_time': 1774715652.0, 'created_time': 1774550632.523109, 'last_price_update_time': 1774676260.977024}
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS57817') HTTP/1.1" 204 0
2026-03-28 05:37:41 [auto1.de] INFO: Found listing with ID: TX62945
2026-03-28 05:37:41 [auto1.de] INFO: Found listing with ID: SR33792
2026-03-28 05:37:41 [auto1.de] INFO: Found listing with ID: VK33233
2026-03-28 05:37:41 [auto1.de] INFO: Found listing with ID: VW53708
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW53708%27 HTTP/1.1" 200 None
2026-03-28 05:37:41 [auto1.de] INFO: Scrape type for VW53708: 0
2026-03-28 05:37:41 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-28 05:37:41 [auto1.de] INFO: Found listing with ID: VA97546
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA97546%27 HTTP/1.1" 200 None
2026-03-28 05:37:41 [auto1.de] INFO: Scrape type for VA97546: 0
2026-03-28 05:37:41 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN72573%27 HTTP/1.1" 200 None
2026-03-28 05:37:41 [auto1.de] INFO: Scrape type for WN72573: 0
2026-03-28 05:37:41 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL48750%27 HTTP/1.1" 200 None
2026-03-28 05:37:41 [auto1.de] INFO: Scrape type for VL48750: 0
2026-03-28 05:37:41 [auto1.de] INFO: Found listing with ID: BG60568
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG60568%27 HTTP/1.1" 200 None
2026-03-28 05:37:41 [auto1.de] INFO: Scrape type for BG60568: 0
2026-03-28 05:37:41 [auto1.de] INFO: Found listing with ID: HP43696
2026-03-28 05:37:41 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-28 05:37:41 [auto1.de] INFO: Scrape type for CB52035: 2
2026-03-28 05:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035
2026-03-28 05:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c545d778-8fe6-53f9-b700-b5146a776dc7 with scrape type 2
2026-03-28 05:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c545d778-8fe6-53f9-b700-b5146a776dc7 with scrape type 2
2026-03-28 05:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c545d778-8fe6-53f9-b700-b5146a776dc7, identifier: CB52035
2026-03-28 05:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035
2026-03-28 05:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035
2026-03-28 05:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035 to the API
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:21:43Z',
 'fuel_type': 'petrol',
 'id': 'c545d778-8fe6-53f9-b700-b5146a776dc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB52035',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 123112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-13',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Exclusive-Line',
 'transmission': 'manual',
 'trim': 'Exclusive-Line',
 'year': 2015}
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-28 05:37:41 [auto1.de] INFO: Saving data for CB52035: {'auction_closing_time': 1774714903.0, 'created_time': 1774552718.204607, 'last_price_update_time': 1774676261.580611}
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB52035') HTTP/1.1" 204 0
2026-03-28 05:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:42 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:42 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-28 05:37:42 [auto1.de] INFO: Found listing with ID: KH64272
2026-03-28 05:37:42 [auto1.de] INFO: Found listing with ID: DP86097
2026-03-28 05:37:42 [auto1.de] INFO: Found listing with ID: TF55396
2026-03-28 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF55396%27 HTTP/1.1" 200 None
2026-03-28 05:37:42 [auto1.de] INFO: Scrape type for TF55396: 0
2026-03-28 05:37:42 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-28 05:37:42 [auto1.de] INFO: Found listing with ID: BS18924
2026-03-28 05:37:42 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-28 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-28 05:37:42 [auto1.de] INFO: Scrape type for CK27476: 2
2026-03-28 05:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476
2026-03-28 05:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 330338cb-3703-531e-bfe6-681a9cf1fdff with scrape type 2
2026-03-28 05:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 330338cb-3703-531e-bfe6-681a9cf1fdff with scrape type 2
2026-03-28 05:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 330338cb-3703-531e-bfe6-681a9cf1fdff, identifier: CK27476
2026-03-28 05:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476
2026-03-28 05:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476
2026-03-28 05:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476 to the API
2026-03-28 05:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:24:35Z',
 'fuel_type': 'diesel',
 'id': '330338cb-3703-531e-bfe6-681a9cf1fdff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK27476',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 140795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-11',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2012}
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-28 05:37:43 [auto1.de] INFO: Saving data for CK27476: {'auction_closing_time': 1774715075.0, 'created_time': 1774552967.285749, 'last_price_update_time': 1774676263.184185}
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK27476') HTTP/1.1" 204 0
2026-03-28 05:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:43 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-28 05:37:43 [auto1.de] INFO: Found listing with ID: DH62820
2026-03-28 05:37:43 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-28 05:37:43 [auto1.de] INFO: Scrape type for GJ72633: 0
2026-03-28 05:37:43 [auto1.de] INFO: Found listing with ID: SL64623
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL64623%27 HTTP/1.1" 200 None
2026-03-28 05:37:43 [auto1.de] INFO: Scrape type for SL64623: 0
2026-03-28 05:37:43 [auto1.de] INFO: Found listing with ID: SZ82893
2026-03-28 05:37:43 [auto1.de] INFO: Found listing with ID: NB86362
2026-03-28 05:37:43 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-28 05:37:43 [auto1.de] INFO: Found listing with ID: SK30483
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK30483%27 HTTP/1.1" 200 None
2026-03-28 05:37:43 [auto1.de] INFO: Scrape type for SK30483: 2
2026-03-28 05:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4a99bb-e25e-5235-a57c-0d270f8f10ab with identifier: SK30483
2026-03-28 05:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4a99bb-e25e-5235-a57c-0d270f8f10ab with scrape type 2
2026-03-28 05:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c4a99bb-e25e-5235-a57c-0d270f8f10ab with scrape type 2
2026-03-28 05:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c4a99bb-e25e-5235-a57c-0d270f8f10ab, identifier: SK30483
2026-03-28 05:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c4a99bb-e25e-5235-a57c-0d270f8f10ab with identifier: SK30483
2026-03-28 05:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c4a99bb-e25e-5235-a57c-0d270f8f10ab with identifier: SK30483
2026-03-28 05:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c4a99bb-e25e-5235-a57c-0d270f8f10ab with identifier: SK30483 to the API
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:56Z',
 'fuel_type': 'diesel',
 'id': '5c4a99bb-e25e-5235-a57c-0d270f8f10ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK30483',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 148839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-15',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang',
 'transmission': 'automatic',
 'trim': 'Comfortline lang',
 'year': 2015}
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK30483%27 HTTP/1.1" 200 None
2026-03-28 05:37:43 [auto1.de] INFO: Saving data for SK30483: {'auction_closing_time': 1774714796.0, 'created_time': 1773132603.634446, 'last_price_update_time': 1774676263.710091}
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK30483') HTTP/1.1" 204 0
2026-03-28 05:37:43 [auto1.de] INFO: Found listing with ID: WT98226
2026-03-28 05:37:43 [auto1.de] INFO: Found listing with ID: WW97819
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW97819%27 HTTP/1.1" 200 None
2026-03-28 05:37:43 [auto1.de] INFO: Scrape type for WW97819: 2
2026-03-28 05:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45413a58-7743-5467-a5c1-9544a3b17fa3 with identifier: WW97819
2026-03-28 05:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45413a58-7743-5467-a5c1-9544a3b17fa3 with scrape type 2
2026-03-28 05:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45413a58-7743-5467-a5c1-9544a3b17fa3 with scrape type 2
2026-03-28 05:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45413a58-7743-5467-a5c1-9544a3b17fa3, identifier: WW97819
2026-03-28 05:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45413a58-7743-5467-a5c1-9544a3b17fa3 with identifier: WW97819
2026-03-28 05:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45413a58-7743-5467-a5c1-9544a3b17fa3 with identifier: WW97819
2026-03-28 05:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45413a58-7743-5467-a5c1-9544a3b17fa3 with identifier: WW97819 to the API
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:27Z',
 'fuel_type': 'diesel',
 'id': '45413a58-7743-5467-a5c1-9544a3b17fa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW97819',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 188805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-21',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2017}
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW97819%27 HTTP/1.1" 200 None
2026-03-28 05:37:44 [auto1.de] INFO: Saving data for WW97819: {'auction_closing_time': 1774714827.0, 'created_time': 1774467731.255433, 'last_price_update_time': 1774676264.251976}
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW97819') HTTP/1.1" 204 0
2026-03-28 05:37:44 [auto1.de] INFO: Found listing with ID: UN48068
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN48068%27 HTTP/1.1" 200 None
2026-03-28 05:37:44 [auto1.de] INFO: Scrape type for UN48068: 2
2026-03-28 05:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d5fd5cd-050b-58ad-8915-fd99183f12b3 with identifier: UN48068
2026-03-28 05:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d5fd5cd-050b-58ad-8915-fd99183f12b3 with scrape type 2
2026-03-28 05:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d5fd5cd-050b-58ad-8915-fd99183f12b3 with scrape type 2
2026-03-28 05:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d5fd5cd-050b-58ad-8915-fd99183f12b3, identifier: UN48068
2026-03-28 05:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d5fd5cd-050b-58ad-8915-fd99183f12b3 with identifier: UN48068
2026-03-28 05:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d5fd5cd-050b-58ad-8915-fd99183f12b3 with identifier: UN48068
2026-03-28 05:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d5fd5cd-050b-58ad-8915-fd99183f12b3 with identifier: UN48068 to the API
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:22:37Z',
 'fuel_type': 'petrol',
 'id': '8d5fd5cd-050b-58ad-8915-fd99183f12b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN48068',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 37976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2018}
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN48068%27 HTTP/1.1" 200 None
2026-03-28 05:37:44 [auto1.de] INFO: Saving data for UN48068: {'auction_closing_time': 1774714957.0, 'created_time': 1774552964.937216, 'last_price_update_time': 1774676264.704011}
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN48068') HTTP/1.1" 204 0
2026-03-28 05:37:44 [auto1.de] INFO: Found listing with ID: MH25393
2026-03-28 05:37:44 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-28 05:37:44 [auto1.de] INFO: Found listing with ID: NF21542
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF21542%27 HTTP/1.1" 200 None
2026-03-28 05:37:44 [auto1.de] INFO: Scrape type for NF21542: 2
2026-03-28 05:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 445123f3-1041-599f-8c3e-225dc5add5b6 with identifier: NF21542
2026-03-28 05:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 445123f3-1041-599f-8c3e-225dc5add5b6 with scrape type 2
2026-03-28 05:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 445123f3-1041-599f-8c3e-225dc5add5b6 with scrape type 2
2026-03-28 05:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 445123f3-1041-599f-8c3e-225dc5add5b6, identifier: NF21542
2026-03-28 05:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 445123f3-1041-599f-8c3e-225dc5add5b6 with identifier: NF21542
2026-03-28 05:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 445123f3-1041-599f-8c3e-225dc5add5b6 with identifier: NF21542
2026-03-28 05:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 445123f3-1041-599f-8c3e-225dc5add5b6 with identifier: NF21542 to the API
2026-03-28 05:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:08Z',
 'fuel_type': 'petrol',
 'id': '445123f3-1041-599f-8c3e-225dc5add5b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF21542',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 228229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-14',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF21542%27 HTTP/1.1" 200 None
2026-03-28 05:37:45 [auto1.de] INFO: Saving data for NF21542: {'auction_closing_time': 1774716068.0, 'created_time': 1773307648.745661, 'last_price_update_time': 1774676265.130927}
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF21542') HTTP/1.1" 204 0
2026-03-28 05:37:45 [auto1.de] INFO: Found listing with ID: YG95815
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG95815%27 HTTP/1.1" 200 None
2026-03-28 05:37:45 [auto1.de] INFO: Scrape type for YG95815: 0
2026-03-28 05:37:45 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-28 05:37:45 [auto1.de] INFO: Found listing with ID: GZ27207
2026-03-28 05:37:45 [auto1.de] INFO: Found listing with ID: BH72065
2026-03-28 05:37:45 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-28 05:37:45 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-28 05:37:45 [auto1.de] INFO: Found listing with ID: YP78886
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP78886%27 HTTP/1.1" 200 None
2026-03-28 05:37:45 [auto1.de] INFO: Scrape type for YP78886: 2
2026-03-28 05:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 228c3257-b1e2-598d-afed-8e86f1c2c3ae with identifier: YP78886
2026-03-28 05:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 228c3257-b1e2-598d-afed-8e86f1c2c3ae with scrape type 2
2026-03-28 05:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 228c3257-b1e2-598d-afed-8e86f1c2c3ae with scrape type 2
2026-03-28 05:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 228c3257-b1e2-598d-afed-8e86f1c2c3ae, identifier: YP78886
2026-03-28 05:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 228c3257-b1e2-598d-afed-8e86f1c2c3ae with identifier: YP78886
2026-03-28 05:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 228c3257-b1e2-598d-afed-8e86f1c2c3ae with identifier: YP78886
2026-03-28 05:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 228c3257-b1e2-598d-afed-8e86f1c2c3ae with identifier: YP78886 to the API
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:53:11Z',
 'fuel_type': 'petrol',
 'id': '228c3257-b1e2-598d-afed-8e86f1c2c3ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP78886',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 119078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 I-Way',
 'transmission': 'manual',
 'trim': 'I-Way',
 'year': 2010}
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP78886%27 HTTP/1.1" 200 None
2026-03-28 05:37:45 [auto1.de] INFO: Saving data for YP78886: {'auction_closing_time': 1774716791.0, 'created_time': 1774466446.870907, 'last_price_update_time': 1774676265.592013}
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP78886') HTTP/1.1" 204 0
2026-03-28 05:37:45 [auto1.de] INFO: Found listing with ID: GG82433
2026-03-28 05:37:45 [auto1.de] INFO: Found listing with ID: US88233
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US88233%27 HTTP/1.1" 200 None
2026-03-28 05:37:45 [auto1.de] INFO: Scrape type for US88233: 2
2026-03-28 05:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58d77e35-fb82-55bb-80c2-9da4bffa12dd with identifier: US88233
2026-03-28 05:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d77e35-fb82-55bb-80c2-9da4bffa12dd with scrape type 2
2026-03-28 05:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58d77e35-fb82-55bb-80c2-9da4bffa12dd with scrape type 2
2026-03-28 05:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58d77e35-fb82-55bb-80c2-9da4bffa12dd, identifier: US88233
2026-03-28 05:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58d77e35-fb82-55bb-80c2-9da4bffa12dd with identifier: US88233
2026-03-28 05:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58d77e35-fb82-55bb-80c2-9da4bffa12dd with identifier: US88233
2026-03-28 05:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58d77e35-fb82-55bb-80c2-9da4bffa12dd with identifier: US88233 to the API
2026-03-28 05:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:39Z',
 'fuel_type': 'diesel',
 'id': '58d77e35-fb82-55bb-80c2-9da4bffa12dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US88233',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 91290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-22',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
 'transmission': 'manual',
 'trim': 'HSE',
 'year': 2015}
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US88233%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Saving data for US88233: {'auction_closing_time': 1774716519.0, 'created_time': 1774466117.041148, 'last_price_update_time': 1774676266.175312}
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US88233') HTTP/1.1" 204 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: AL03330
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL03330%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for AL03330: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: HA17453
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA17453%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for HA17453: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: UE28528
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: PP91103
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP91103%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for PP91103: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: PY54306
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: JH65872
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65872%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for JH65872: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for LX22574: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for DJ97721: 2
2026-03-28 05:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ddd199f-e1f1-5019-8697-6b41934d93eb with identifier: DJ97721
2026-03-28 05:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ddd199f-e1f1-5019-8697-6b41934d93eb with scrape type 2
2026-03-28 05:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ddd199f-e1f1-5019-8697-6b41934d93eb with scrape type 2
2026-03-28 05:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ddd199f-e1f1-5019-8697-6b41934d93eb, identifier: DJ97721
2026-03-28 05:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ddd199f-e1f1-5019-8697-6b41934d93eb with identifier: DJ97721
2026-03-28 05:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ddd199f-e1f1-5019-8697-6b41934d93eb with identifier: DJ97721
2026-03-28 05:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ddd199f-e1f1-5019-8697-6b41934d93eb with identifier: DJ97721 to the API
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:05:01Z',
 'fuel_type': 'petrol',
 'id': '5ddd199f-e1f1-5019-8697-6b41934d93eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ97721',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS Q3',
 'odometer': 116591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-02',
 'seller_name': None,
 'title': 'Audi RS Q3 2.5 TFSI quattro Performance',
 'transmission': 'automatic',
 'trim': 'quattro Performance',
 'year': 2017}
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Saving data for DJ97721: {'auction_closing_time': 1774713901.0, 'created_time': 1774552524.747768, 'last_price_update_time': 1774676266.773073}
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ97721') HTTP/1.1" 204 0
2026-03-28 05:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:46 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: SY63784
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY63784%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for SY63784: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: EX64798
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: WY14478
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for JR56038: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: KP36824
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: XM84350
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM84350%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for XM84350: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: FH12952
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH12952%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for FH12952: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for RS30445: 2
2026-03-28 05:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445
2026-03-28 05:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad27732-66bf-55b6-85c1-679ddc0d5dcf with scrape type 2
2026-03-28 05:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aad27732-66bf-55b6-85c1-679ddc0d5dcf with scrape type 2
2026-03-28 05:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aad27732-66bf-55b6-85c1-679ddc0d5dcf, identifier: RS30445
2026-03-28 05:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445
2026-03-28 05:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445
2026-03-28 05:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445 to the API
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:00:44Z',
 'fuel_type': 'petrol',
 'id': 'aad27732-66bf-55b6-85c1-679ddc0d5dcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS30445',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 40042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 35 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2021}
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Saving data for RS30445: {'auction_closing_time': 1774713644.0, 'created_time': 1773307340.322549, 'last_price_update_time': 1774676267.488437}
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS30445') HTTP/1.1" 204 0
2026-03-28 05:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for GK32978: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: DL87338
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL87338%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for DL87338: 2
2026-03-28 05:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c72450c-98d1-5ea0-b3ba-622646373faa with identifier: DL87338
2026-03-28 05:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c72450c-98d1-5ea0-b3ba-622646373faa with scrape type 2
2026-03-28 05:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c72450c-98d1-5ea0-b3ba-622646373faa with scrape type 2
2026-03-28 05:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c72450c-98d1-5ea0-b3ba-622646373faa, identifier: DL87338
2026-03-28 05:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c72450c-98d1-5ea0-b3ba-622646373faa with identifier: DL87338
2026-03-28 05:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c72450c-98d1-5ea0-b3ba-622646373faa with identifier: DL87338
2026-03-28 05:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c72450c-98d1-5ea0-b3ba-622646373faa with identifier: DL87338 to the API
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-28T16:51:59Z',
 'fuel_type': 'petrol',
 'id': '0c72450c-98d1-5ea0-b3ba-622646373faa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL87338',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 75162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 450 4Matic AMG',
 'transmission': 'automatic',
 'trim': '4Matic AMG',
 'year': 2019}
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL87338%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Saving data for DL87338: {'auction_closing_time': 1774716719.0, 'created_time': 1774466670.881428, 'last_price_update_time': 1774676267.947708}
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL87338') HTTP/1.1" 204 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: KX39833
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: CC31467
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC31467%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for CC31467: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: ZM02354
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM02354%27 HTTP/1.1" 200 None
2026-03-28 05:37:48 [auto1.de] INFO: Scrape type for ZM02354: 0
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: JA10385
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: DG26223
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-28 05:37:48 [auto1.de] INFO: Scrape type for GA19207: 0
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36946%27 HTTP/1.1" 200 None
2026-03-28 05:37:48 [auto1.de] INFO: Scrape type for GY36946: 0
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: GS35122
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS35122%27 HTTP/1.1" 200 None
2026-03-28 05:37:48 [auto1.de] INFO: Scrape type for GS35122: 0
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-28 05:37:48 [auto1.de] INFO: Scrape type for UZ18000: 2
2026-03-28 05:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000
2026-03-28 05:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5fcae3b-e4de-54a3-b145-39c0cd683378 with scrape type 2
2026-03-28 05:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5fcae3b-e4de-54a3-b145-39c0cd683378 with scrape type 2
2026-03-28 05:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5fcae3b-e4de-54a3-b145-39c0cd683378, identifier: UZ18000
2026-03-28 05:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000
2026-03-28 05:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000
2026-03-28 05:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000 to the API
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:34:53Z',
 'fuel_type': 'petrol',
 'id': 'd5fcae3b-e4de-54a3-b145-39c0cd683378',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ18000',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 163026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-28 05:37:48 [auto1.de] INFO: Saving data for UZ18000: {'auction_closing_time': 1774715693.0, 'created_time': 1774552707.478726, 'last_price_update_time': 1774676268.670671}
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ18000') HTTP/1.1" 204 0
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: ZM31431
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM31431%27 HTTP/1.1" 200 None
2026-03-28 05:37:48 [auto1.de] INFO: Scrape type for ZM31431: 0
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: KW13573
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW13573%27 HTTP/1.1" 200 None
2026-03-28 05:37:48 [auto1.de] INFO: Scrape type for KW13573: 0
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: EE01889
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE01889%27 HTTP/1.1" 200 None
2026-03-28 05:37:48 [auto1.de] INFO: Scrape type for EE01889: 0
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: FD10319
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: SK44857
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-28 05:37:48 [auto1.de] INFO: Scrape type for DK81412: 2
2026-03-28 05:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12e7e32a-4db7-54c5-b687-c19ee8026629 with identifier: DK81412
2026-03-28 05:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e7e32a-4db7-54c5-b687-c19ee8026629 with scrape type 2
2026-03-28 05:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12e7e32a-4db7-54c5-b687-c19ee8026629 with scrape type 2
2026-03-28 05:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12e7e32a-4db7-54c5-b687-c19ee8026629, identifier: DK81412
2026-03-28 05:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12e7e32a-4db7-54c5-b687-c19ee8026629 with identifier: DK81412
2026-03-28 05:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12e7e32a-4db7-54c5-b687-c19ee8026629 with identifier: DK81412
2026-03-28 05:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12e7e32a-4db7-54c5-b687-c19ee8026629 with identifier: DK81412 to the API
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:06:05Z',
 'fuel_type': 'petrol',
 'id': '12e7e32a-4db7-54c5-b687-c19ee8026629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK81412',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 110174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-08',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Saving data for DK81412: {'auction_closing_time': 1774713965.0, 'created_time': 1774551734.52958, 'last_price_update_time': 1774676269.24491}
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK81412') HTTP/1.1" 204 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: FK25443
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK25443%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for FK25443: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: FS70562
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS70562%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for FS70562: 2
2026-03-28 05:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d82a32f-cc20-526d-a072-6fc51997aa7c with identifier: FS70562
2026-03-28 05:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d82a32f-cc20-526d-a072-6fc51997aa7c with scrape type 2
2026-03-28 05:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d82a32f-cc20-526d-a072-6fc51997aa7c with scrape type 2
2026-03-28 05:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d82a32f-cc20-526d-a072-6fc51997aa7c, identifier: FS70562
2026-03-28 05:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d82a32f-cc20-526d-a072-6fc51997aa7c with identifier: FS70562
2026-03-28 05:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d82a32f-cc20-526d-a072-6fc51997aa7c with identifier: FS70562
2026-03-28 05:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d82a32f-cc20-526d-a072-6fc51997aa7c with identifier: FS70562 to the API
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:56:17Z',
 'fuel_type': 'petrol',
 'id': '4d82a32f-cc20-526d-a072-6fc51997aa7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS70562',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 37773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-21',
 'seller_name': None,
 'title': 'BMW Z4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS70562%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Saving data for FS70562: {'auction_closing_time': 1774716977.0, 'created_time': 1774467964.925823, 'last_price_update_time': 1774676269.746842}
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS70562') HTTP/1.1" 204 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: UK82813
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: XY75153
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY75153%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for XY75153: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: HS46985
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS46985%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for HS46985: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: JU05593
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU05593%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for JU05593: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: LN75717
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: CA34591
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34591%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for CA34591: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: ZT31160
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for SD17030: 2
2026-03-28 05:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030
2026-03-28 05:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4dffae0-9883-5211-97e0-5506499f7ade with scrape type 2
2026-03-28 05:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4dffae0-9883-5211-97e0-5506499f7ade with scrape type 2
2026-03-28 05:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4dffae0-9883-5211-97e0-5506499f7ade, identifier: SD17030
2026-03-28 05:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030
2026-03-28 05:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030
2026-03-28 05:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030 to the API
2026-03-28 05:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:02:28Z',
 'fuel_type': 'petrol',
 'id': 'b4dffae0-9883-5211-97e0-5506499f7ade',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD17030',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 100374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-08',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-28 05:37:51 [auto1.de] INFO: Saving data for SD17030: {'auction_closing_time': 1774713748.0, 'created_time': 1773227290.29476, 'last_price_update_time': 1774676271.20416}
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD17030') HTTP/1.1" 204 0
2026-03-28 05:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:51 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-28 05:37:51 [auto1.de] INFO: Scrape type for VS80969: 0
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: JJ00405
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ00405%27 HTTP/1.1" 200 None
2026-03-28 05:37:51 [auto1.de] INFO: Scrape type for JJ00405: 0
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: TY80313
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: RP79325
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP79325%27 HTTP/1.1" 200 None
2026-03-28 05:37:51 [auto1.de] INFO: Scrape type for RP79325: 0
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-28 05:37:51 [auto1.de] INFO: Scrape type for KG01306: 2
2026-03-28 05:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306
2026-03-28 05:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6614e19-e614-5e2b-920a-95a00d82c0f5 with scrape type 2
2026-03-28 05:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6614e19-e614-5e2b-920a-95a00d82c0f5 with scrape type 2
2026-03-28 05:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6614e19-e614-5e2b-920a-95a00d82c0f5, identifier: KG01306
2026-03-28 05:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306
2026-03-28 05:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306
2026-03-28 05:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306 to the API
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:36:34Z',
 'fuel_type': 'diesel',
 'id': 'a6614e19-e614-5e2b-920a-95a00d82c0f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG01306',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 99457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi Acenta 4x4',
 'transmission': 'manual',
 'trim': 'Acenta 4x4',
 'year': 2017}
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-28 05:37:51 [auto1.de] INFO: Saving data for KG01306: {'auction_closing_time': 1774715794.0, 'created_time': 1774552928.753283, 'last_price_update_time': 1774676271.91336}
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG01306') HTTP/1.1" 204 0
2026-03-28 05:37:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: MU08811
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU08811%27 HTTP/1.1" 200 None
2026-03-28 05:37:51 [auto1.de] INFO: Scrape type for MU08811: 0
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: BH79030
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH79030%27 HTTP/1.1" 200 None
2026-03-28 05:37:51 [auto1.de] INFO: Scrape type for BH79030: 0
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-28 05:37:51 [auto1.de] INFO: Scrape type for JU32018: 0
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT99615%27 HTTP/1.1" 200 None
2026-03-28 05:37:51 [auto1.de] INFO: Scrape type for JT99615: 0
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: BB60777
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: JP78451
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: AG20717
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: CH88206
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH88206%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for CH88206: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: KP40091
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP40091%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for KP40091: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: SX62483
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: UW75870
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: NC84547
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: UR62816
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: LC00644
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: SX42326
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: JB63291
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: BE29986
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE29986%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for BE29986: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for XR74072: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for ZL38204: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: UE64486
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE64486%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for UE64486: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: WW56601
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW56601%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for WW56601: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87000%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for HP87000: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: NM87111
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: UP64202
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP64202%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for UP64202: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for ZA74026: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: UC78818
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: VA46995
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for TP67168: 2
2026-03-28 05:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168
2026-03-28 05:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd4d367-55fa-520f-ac5a-74219e842e77 with scrape type 2
2026-03-28 05:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfd4d367-55fa-520f-ac5a-74219e842e77 with scrape type 2
2026-03-28 05:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bfd4d367-55fa-520f-ac5a-74219e842e77, identifier: TP67168
2026-03-28 05:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168
2026-03-28 05:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168
2026-03-28 05:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168 to the API
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:14:44Z',
 'fuel_type': 'diesel',
 'id': 'bfd4d367-55fa-520f-ac5a-74219e842e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP67168',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 290646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueTDI',
 'transmission': 'manual',
 'trim': 'Comfortline BlueTDI',
 'year': 2012}
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Saving data for TP67168: {'auction_closing_time': 1774714484.0, 'created_time': 1774552845.937505, 'last_price_update_time': 1774676272.583841}
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP67168') HTTP/1.1" 204 0
2026-03-28 05:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:53 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: FR76409
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR76409%27 HTTP/1.1" 200 None
2026-03-28 05:37:53 [auto1.de] INFO: Scrape type for FR76409: 0
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: EW53480
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW53480%27 HTTP/1.1" 200 None
2026-03-28 05:37:53 [auto1.de] INFO: Scrape type for EW53480: 0
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: KN86570
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-28 05:37:53 [auto1.de] INFO: Scrape type for SZ10404: 0
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: YB59373
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB59373%27 HTTP/1.1" 200 None
2026-03-28 05:37:53 [auto1.de] INFO: Scrape type for YB59373: 0
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97276%27 HTTP/1.1" 200 None
2026-03-28 05:37:53 [auto1.de] INFO: Scrape type for BT97276: 0
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: LL77007
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: CH65115
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-28 05:37:53 [auto1.de] INFO: Scrape type for FW15462: 0
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: XV72544
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72544%27 HTTP/1.1" 200 None
2026-03-28 05:37:53 [auto1.de] INFO: Scrape type for XV72544: 0
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: CY78505
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY78505%27 HTTP/1.1" 200 None
2026-03-28 05:37:53 [auto1.de] INFO: Scrape type for CY78505: 0
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: SB50693
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: PL37483
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: KR09634
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR09634%27 HTTP/1.1" 200 None
2026-03-28 05:37:53 [auto1.de] INFO: Scrape type for KR09634: 2
2026-03-28 05:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfdd3ed1-6056-5802-b352-4bd721d4f387 with identifier: KR09634
2026-03-28 05:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfdd3ed1-6056-5802-b352-4bd721d4f387 with scrape type 2
2026-03-28 05:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfdd3ed1-6056-5802-b352-4bd721d4f387 with scrape type 2
2026-03-28 05:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfdd3ed1-6056-5802-b352-4bd721d4f387, identifier: KR09634
2026-03-28 05:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfdd3ed1-6056-5802-b352-4bd721d4f387 with identifier: KR09634
2026-03-28 05:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfdd3ed1-6056-5802-b352-4bd721d4f387 with identifier: KR09634
2026-03-28 05:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfdd3ed1-6056-5802-b352-4bd721d4f387 with identifier: KR09634 to the API
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:34Z',
 'fuel_type': 'diesel',
 'id': 'dfdd3ed1-6056-5802-b352-4bd721d4f387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR09634',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 199547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-01',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR09634%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Saving data for KR09634: {'auction_closing_time': 1774714954.0, 'created_time': 1773741403.256811, 'last_price_update_time': 1774676274.164264}
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR09634') HTTP/1.1" 204 0
2026-03-28 05:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: XD09814
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: BF67305
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: AD64899
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: LK57603
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: ZH99212
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH99212%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for ZH99212: 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: PK80050
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for KR99013: 2
2026-03-28 05:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013
2026-03-28 05:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b94dc017-64c8-56df-95f3-24eb36c7e3f6 with scrape type 2
2026-03-28 05:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b94dc017-64c8-56df-95f3-24eb36c7e3f6 with scrape type 2
2026-03-28 05:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b94dc017-64c8-56df-95f3-24eb36c7e3f6, identifier: KR99013
2026-03-28 05:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013
2026-03-28 05:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013
2026-03-28 05:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013 to the API
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:33Z',
 'fuel_type': 'petrol',
 'id': 'b94dc017-64c8-56df-95f3-24eb36c7e3f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR99013',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 100815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-20',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2022}
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Saving data for KR99013: {'auction_closing_time': 1774716153.0, 'created_time': 1774552737.954617, 'last_price_update_time': 1774676274.712702}
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR99013') HTTP/1.1" 204 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: UN95806
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: GU98415
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU98415%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for GU98415: 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: GJ43799
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: XV29391
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for AF84640: 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS26334%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for MS26334: 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: SC29196
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: LP17470
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP17470%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for LP17470: 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: XJ94036
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69189%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for UM69189: 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for LU22691: 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: XE74160
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE74160%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for XE74160: 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: DP90714
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-28 05:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:55 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:55 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-28 05:37:55 [auto1.de] INFO: Found listing with ID: JL28573
2026-03-28 05:37:55 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-28 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-28 05:37:55 [auto1.de] INFO: Scrape type for UA36533: 0
2026-03-28 05:37:55 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-28 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67695%27 HTTP/1.1" 200 None
2026-03-28 05:37:55 [auto1.de] INFO: Scrape type for EA67695: 0
2026-03-28 05:37:55 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-28 05:37:55 [auto1.de] INFO: Found listing with ID: CK75631
2026-03-28 05:37:55 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-28 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-28 05:37:55 [auto1.de] INFO: Scrape type for VJ59637: 0
2026-03-28 05:37:55 [auto1.de] INFO: Found listing with ID: ZR47880
2026-03-28 05:37:55 [auto1.de] INFO: Found listing with ID: DX70553
2026-03-28 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX70553%27 HTTP/1.1" 200 None
2026-03-28 05:37:55 [auto1.de] INFO: Scrape type for DX70553: 0
2026-03-28 05:37:55 [auto1.de] INFO: Found listing with ID: PT89540
2026-03-28 05:37:55 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-28 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-28 05:37:55 [auto1.de] INFO: Scrape type for EU24195: 2
2026-03-28 05:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195
2026-03-28 05:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with scrape type 2
2026-03-28 05:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with scrape type 2
2026-03-28 05:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce, identifier: EU24195
2026-03-28 05:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195
2026-03-28 05:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195
2026-03-28 05:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195 to the API
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:30:03Z',
 'fuel_type': 'diesel',
 'id': '8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU24195',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 300756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-31',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2010}
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Saving data for EU24195: {'auction_closing_time': 1774715403.0, 'created_time': 1774552550.675263, 'last_price_update_time': 1774676276.302301}
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU24195') HTTP/1.1" 204 0
2026-03-28 05:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: AT83868
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT83868%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for AT83868: 2
2026-03-28 05:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf43f019-22ae-585b-be01-11eb9342283a with identifier: AT83868
2026-03-28 05:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf43f019-22ae-585b-be01-11eb9342283a with scrape type 2
2026-03-28 05:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf43f019-22ae-585b-be01-11eb9342283a with scrape type 2
2026-03-28 05:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf43f019-22ae-585b-be01-11eb9342283a, identifier: AT83868
2026-03-28 05:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf43f019-22ae-585b-be01-11eb9342283a with identifier: AT83868
2026-03-28 05:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf43f019-22ae-585b-be01-11eb9342283a with identifier: AT83868
2026-03-28 05:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf43f019-22ae-585b-be01-11eb9342283a with identifier: AT83868 to the API
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:49:15Z',
 'fuel_type': 'petrol',
 'id': 'bf43f019-22ae-585b-be01-11eb9342283a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT83868',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 86427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-23',
 'seller_name': None,
 'title': 'Hyundai ix20 1.6 YES! Blue',
 'transmission': 'manual',
 'trim': 'YES! Blue',
 'year': 2015}
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT83868%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Saving data for AT83868: {'auction_closing_time': 1774716555.0, 'created_time': 1774551831.785602, 'last_price_update_time': 1774676276.853642}
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT83868') HTTP/1.1" 204 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: CY41602
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: KF01282
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: EA51834
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: SH57495
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH57495%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for SH57495: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: HX02053
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX02053%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for HX02053: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: HJ19382
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: GK12376
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for FC40686: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV92050%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for BV92050: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: DE15792
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE15792%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for DE15792: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for YP19468: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48186%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for FG48186: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: YC07614
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC07614%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for YC07614: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: VW16070
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: EG70840
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG70840%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for EG70840: 2
2026-03-28 05:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3b37b45-d227-5500-bd2f-d0389e6c482b with identifier: EG70840
2026-03-28 05:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3b37b45-d227-5500-bd2f-d0389e6c482b with scrape type 2
2026-03-28 05:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3b37b45-d227-5500-bd2f-d0389e6c482b with scrape type 2
2026-03-28 05:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3b37b45-d227-5500-bd2f-d0389e6c482b, identifier: EG70840
2026-03-28 05:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3b37b45-d227-5500-bd2f-d0389e6c482b with identifier: EG70840
2026-03-28 05:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3b37b45-d227-5500-bd2f-d0389e6c482b with identifier: EG70840
2026-03-28 05:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3b37b45-d227-5500-bd2f-d0389e6c482b with identifier: EG70840 to the API
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:55:11Z',
 'fuel_type': 'diesel',
 'id': 'f3b37b45-d227-5500-bd2f-d0389e6c482b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG70840',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 67923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-25',
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend lang',
 'transmission': 'manual',
 'trim': 'Kasten Trend lang',
 'year': 2019}
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG70840%27 HTTP/1.1" 200 None
2026-03-28 05:37:57 [auto1.de] INFO: Saving data for EG70840: {'auction_closing_time': 1774716911.0, 'created_time': 1774552710.206707, 'last_price_update_time': 1774676277.388818}
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG70840') HTTP/1.1" 204 0
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: TW42181
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW42181%27 HTTP/1.1" 200 None
2026-03-28 05:37:57 [auto1.de] INFO: Scrape type for TW42181: 0
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: HZ36583
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: HU95530
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU95530%27 HTTP/1.1" 200 None
2026-03-28 05:37:57 [auto1.de] INFO: Scrape type for HU95530: 0
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: DB47248
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-28 05:37:57 [auto1.de] INFO: Scrape type for DD95746: 0
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: FT13435
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT13435%27 HTTP/1.1" 200 None
2026-03-28 05:37:57 [auto1.de] INFO: Scrape type for FT13435: 0
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-28 05:37:57 [auto1.de] INFO: Scrape type for KL26301: 0
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-28 05:37:57 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-28 05:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:01 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: KR15967
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: FL13933
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL13933%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for FL13933: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: UG79449
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG79449%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for UG79449: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: MF18301
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF18301%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for MF18301: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: EY99757
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY99757%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for EY99757: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: KJ94433
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ94433%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for KJ94433: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: SY52709
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY52709%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for SY52709: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: GC15327
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC15327%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for GC15327: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: PC96089
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC96089%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for PC96089: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: GW32993
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: ZE91614
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: MD38661
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: LW74577
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for VK94352: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: DA94168
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW56335%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for NW56335: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: CS67228
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for MM36361: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: AP69664
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: CZ73212
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73212%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for CZ73212: 2
2026-03-28 05:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07a7585d-ad80-51bf-9d73-49b3ca0a845b with identifier: CZ73212
2026-03-28 05:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07a7585d-ad80-51bf-9d73-49b3ca0a845b with scrape type 2
2026-03-28 05:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07a7585d-ad80-51bf-9d73-49b3ca0a845b with scrape type 2
2026-03-28 05:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07a7585d-ad80-51bf-9d73-49b3ca0a845b, identifier: CZ73212
2026-03-28 05:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07a7585d-ad80-51bf-9d73-49b3ca0a845b with identifier: CZ73212
2026-03-28 05:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07a7585d-ad80-51bf-9d73-49b3ca0a845b with identifier: CZ73212
2026-03-28 05:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07a7585d-ad80-51bf-9d73-49b3ca0a845b with identifier: CZ73212 to the API
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:33:27Z',
 'fuel_type': 'diesel',
 'id': '07a7585d-ad80-51bf-9d73-49b3ca0a845b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ73212',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 253570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 114 CDI lang Pro',
 'transmission': 'automatic',
 'trim': 'lang Pro',
 'year': 2017}
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73212%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Saving data for CZ73212: {'auction_closing_time': 1774715607.0, 'created_time': 1774551495.562084, 'last_price_update_time': 1774676283.210249}
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ73212') HTTP/1.1" 204 0
2026-03-28 05:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: EV67878
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV67878%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for EV67878: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ11746%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for TZ11746: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: SP13304
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP13304%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for SP13304: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: CX40237
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX40237%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for CX40237: 2
2026-03-28 05:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 620172ed-a24a-5791-bec1-5b94cd171209 with identifier: CX40237
2026-03-28 05:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 620172ed-a24a-5791-bec1-5b94cd171209 with scrape type 2
2026-03-28 05:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 620172ed-a24a-5791-bec1-5b94cd171209 with scrape type 2
2026-03-28 05:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 620172ed-a24a-5791-bec1-5b94cd171209, identifier: CX40237
2026-03-28 05:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 620172ed-a24a-5791-bec1-5b94cd171209 with identifier: CX40237
2026-03-28 05:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 620172ed-a24a-5791-bec1-5b94cd171209 with identifier: CX40237
2026-03-28 05:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 620172ed-a24a-5791-bec1-5b94cd171209 with identifier: CX40237 to the API
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:05Z',
 'fuel_type': 'petrol',
 'id': '620172ed-a24a-5791-bec1-5b94cd171209',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX40237',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 89178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX40237%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Saving data for CX40237: {'auction_closing_time': 1774715525.0, 'created_time': 1774468212.116221, 'last_price_update_time': 1774676283.794944}
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX40237') HTTP/1.1" 204 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: CK60135
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK60135%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for CK60135: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: KT50615
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT50615%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for KT50615: 2
2026-03-28 05:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3934a1c-6af8-52da-b2de-95181a283d13 with identifier: KT50615
2026-03-28 05:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3934a1c-6af8-52da-b2de-95181a283d13 with scrape type 2
2026-03-28 05:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3934a1c-6af8-52da-b2de-95181a283d13 with scrape type 2
2026-03-28 05:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3934a1c-6af8-52da-b2de-95181a283d13, identifier: KT50615
2026-03-28 05:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3934a1c-6af8-52da-b2de-95181a283d13 with identifier: KT50615
2026-03-28 05:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3934a1c-6af8-52da-b2de-95181a283d13 with identifier: KT50615
2026-03-28 05:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3934a1c-6af8-52da-b2de-95181a283d13 with identifier: KT50615 to the API
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:36:45Z',
 'fuel_type': 'diesel',
 'id': 'b3934a1c-6af8-52da-b2de-95181a283d13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT50615',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 152028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-18',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2011}
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT50615%27 HTTP/1.1" 200 None
2026-03-28 05:38:04 [auto1.de] INFO: Saving data for KT50615: {'auction_closing_time': 1774715805.0, 'created_time': 1773830941.965816, 'last_price_update_time': 1774676284.232864}
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT50615') HTTP/1.1" 204 0
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: VD25373
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE60252%27 HTTP/1.1" 200 None
2026-03-28 05:38:04 [auto1.de] INFO: Scrape type for LE60252: 0
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35260%27 HTTP/1.1" 200 None
2026-03-28 05:38:04 [auto1.de] INFO: Scrape type for ZU35260: 0
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: CR67511
2026-03-28 05:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:05 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: RT10387
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: TF12551
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF12551%27 HTTP/1.1" 200 None
2026-03-28 05:38:05 [auto1.de] INFO: Scrape type for TF12551: 0
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: NA95375
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA95375%27 HTTP/1.1" 200 None
2026-03-28 05:38:05 [auto1.de] INFO: Scrape type for NA95375: 0
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-28 05:38:05 [auto1.de] INFO: Scrape type for HV21869: 2
2026-03-28 05:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869
2026-03-28 05:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2f212d7-cafe-5533-a353-89c6013d5fb6 with scrape type 2
2026-03-28 05:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2f212d7-cafe-5533-a353-89c6013d5fb6 with scrape type 2
2026-03-28 05:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2f212d7-cafe-5533-a353-89c6013d5fb6, identifier: HV21869
2026-03-28 05:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869
2026-03-28 05:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869
2026-03-28 05:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869 to the API
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:19:23Z',
 'fuel_type': 'petrol',
 'id': 'f2f212d7-cafe-5533-a353-89c6013d5fb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV21869',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 91979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-31',
 'seller_name': None,
 'title': 'Honda Jazz 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Saving data for HV21869: {'auction_closing_time': 1774714763.0, 'created_time': 1774552721.987186, 'last_price_update_time': 1774676286.004907}
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV21869') HTTP/1.1" 204 0
2026-03-28 05:38:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: CY33592
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33592%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for CY33592: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: HF35656
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: FU70567
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU70567%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for FU70567: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: ZF79650
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF79650%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for ZF79650: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for FG50189: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: RA78002
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for AX13429: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: DK74587
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: UT06922
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT06922%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for UT06922: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: NY29547
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY29547%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for NY29547: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: AS57198
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS57198%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for AS57198: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: AK11207
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: WM78978
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78978%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for WM78978: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for GV09290: 2
2026-03-28 05:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290
2026-03-28 05:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c633b2a0-7b9d-5b03-a832-d699cff4719e with scrape type 2
2026-03-28 05:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c633b2a0-7b9d-5b03-a832-d699cff4719e with scrape type 2
2026-03-28 05:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c633b2a0-7b9d-5b03-a832-d699cff4719e, identifier: GV09290
2026-03-28 05:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290
2026-03-28 05:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290
2026-03-28 05:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290 to the API
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:49:47Z',
 'fuel_type': 'petrol',
 'id': 'c633b2a0-7b9d-5b03-a832-d699cff4719e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV09290',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 39195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Ice 4x2',
 'transmission': 'manual',
 'trim': 'Ice 4x2',
 'year': 2016}
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Saving data for GV09290: {'auction_closing_time': 1774716587.0, 'created_time': 1773946114.099924, 'last_price_update_time': 1774676286.700842}
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV09290') HTTP/1.1" 204 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: AV68122
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV68122%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for AV68122: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: AX02207
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX02207%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for AX02207: 2
2026-03-28 05:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f8e95d2-8eb2-58fb-9c8c-4732fbf48dbd with identifier: AX02207
2026-03-28 05:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f8e95d2-8eb2-58fb-9c8c-4732fbf48dbd with scrape type 2
2026-03-28 05:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f8e95d2-8eb2-58fb-9c8c-4732fbf48dbd with scrape type 2
2026-03-28 05:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f8e95d2-8eb2-58fb-9c8c-4732fbf48dbd, identifier: AX02207
2026-03-28 05:38:07 [scrapy.extensions.logstats] INFO: Crawled 145 pages (at 13 pages/min), scraped 546 items (at 54 items/min)
2026-03-28 05:38:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f8e95d2-8eb2-58fb-9c8c-4732fbf48dbd with identifier: AX02207
2026-03-28 05:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f8e95d2-8eb2-58fb-9c8c-4732fbf48dbd with identifier: AX02207
2026-03-28 05:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f8e95d2-8eb2-58fb-9c8c-4732fbf48dbd with identifier: AX02207 to the API
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:49:25Z',
 'fuel_type': 'petrol',
 'id': '5f8e95d2-8eb2-58fb-9c8c-4732fbf48dbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX02207',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 126021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-27',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Intense 2WD',
 'transmission': 'manual',
 'trim': 'Intense 2WD',
 'year': 2012}
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX02207%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Saving data for AX02207: {'auction_closing_time': 1774716565.0, 'created_time': 1774466686.883462, 'last_price_update_time': 1774676287.377417}
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX02207') HTTP/1.1" 204 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: ZY72321
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: AS95642
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS95642%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for AS95642: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: LN37721
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for GJ61824: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: CB57025
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB57025%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for CB57025: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: FN85250
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: YF69717
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG94369%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for NG94369: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: VT62851
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: WW96945
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW96945%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for WW96945: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: JD69388
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD69388%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for JD69388: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: DM70532
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: RL18090
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: FT69115
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: BS00232
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00232%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for BS00232: 2
2026-03-28 05:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f12fdfb-cae2-55c4-b9c4-5ceb67ba3beb with identifier: BS00232
2026-03-28 05:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f12fdfb-cae2-55c4-b9c4-5ceb67ba3beb with scrape type 2
2026-03-28 05:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f12fdfb-cae2-55c4-b9c4-5ceb67ba3beb with scrape type 2
2026-03-28 05:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f12fdfb-cae2-55c4-b9c4-5ceb67ba3beb, identifier: BS00232
2026-03-28 05:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f12fdfb-cae2-55c4-b9c4-5ceb67ba3beb with identifier: BS00232
2026-03-28 05:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f12fdfb-cae2-55c4-b9c4-5ceb67ba3beb with identifier: BS00232
2026-03-28 05:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f12fdfb-cae2-55c4-b9c4-5ceb67ba3beb with identifier: BS00232 to the API
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:54:10Z',
 'fuel_type': 'petrol',
 'id': '5f12fdfb-cae2-55c4-b9c4-5ceb67ba3beb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS00232',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 60785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-20',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Sports-Line AWD',
 'transmission': 'manual',
 'trim': 'Sports-Line AWD',
 'year': 2018}
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00232%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Saving data for BS00232: {'auction_closing_time': 1774716850.0, 'created_time': 1774552319.870006, 'last_price_update_time': 1774676287.923164}
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS00232') HTTP/1.1" 204 0
2026-03-28 05:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:08 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: TW55343
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: WC00524
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC00524%27 HTTP/1.1" 200 None
2026-03-28 05:38:08 [auto1.de] INFO: Scrape type for WC00524: 0
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: ZV20362
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: KU28834
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU28834%27 HTTP/1.1" 200 None
2026-03-28 05:38:08 [auto1.de] INFO: Scrape type for KU28834: 0
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG14564%27 HTTP/1.1" 200 None
2026-03-28 05:38:08 [auto1.de] INFO: Scrape type for VG14564: 0
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: BU12505
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU12505%27 HTTP/1.1" 200 None
2026-03-28 05:38:08 [auto1.de] INFO: Scrape type for BU12505: 0
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-28 05:38:08 [auto1.de] INFO: Scrape type for MA44978: 2
2026-03-28 05:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978
2026-03-28 05:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f785a168-36e5-57c6-9138-cf3c9e01bf69 with scrape type 2
2026-03-28 05:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f785a168-36e5-57c6-9138-cf3c9e01bf69 with scrape type 2
2026-03-28 05:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f785a168-36e5-57c6-9138-cf3c9e01bf69, identifier: MA44978
2026-03-28 05:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978
2026-03-28 05:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978
2026-03-28 05:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978 to the API
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:26Z',
 'fuel_type': 'diesel',
 'id': 'f785a168-36e5-57c6-9138-cf3c9e01bf69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA44978',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 186405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-23',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2014}
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Saving data for MA44978: {'auction_closing_time': 1774715546.0, 'created_time': 1774550639.849563, 'last_price_update_time': 1774676289.388686}
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA44978') HTTP/1.1" 204 0
2026-03-28 05:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: GL77539
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE72511%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for ZE72511: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: VZ65007
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ65007%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for VZ65007: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: MF25653
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF25653%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for MF25653: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: GW56930
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93361%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for UW93361: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: MC31762
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG76921%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for CG76921: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: TL37084
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: RD14562
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: YC46871
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: VZ15910
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20654%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for FB20654: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: HU58633
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: FF65657
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF65657%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for FF65657: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: WM87026
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75533%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for FR75533: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: FE80519
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE80519%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for FE80519: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS88634%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for CS88634: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: HX41929
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for RW09760: 0
2026-03-28 05:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:10 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: YY13895
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13895%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for YY13895: 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: SS50589
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: JJ00785
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: GK14765
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14765%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for GK14765: 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: RC56290
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC56290%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for RC56290: 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99703%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for AU99703: 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: XU63236
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU63236%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for XU63236: 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: UH34281
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34281%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for UH34281: 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT28952%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for MT28952: 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: DX28979
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: DF27439
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF27439%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for DF27439: 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: JN60731
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: LX06278
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX06278%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for LX06278: 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: ZA89308
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: ZA98162
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for AS79616: 2
2026-03-28 05:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2a7e67c-4c78-5406-a70a-3e2ede768348 with identifier: AS79616
2026-03-28 05:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2a7e67c-4c78-5406-a70a-3e2ede768348 with scrape type 2
2026-03-28 05:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2a7e67c-4c78-5406-a70a-3e2ede768348 with scrape type 2
2026-03-28 05:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2a7e67c-4c78-5406-a70a-3e2ede768348, identifier: AS79616
2026-03-28 05:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2a7e67c-4c78-5406-a70a-3e2ede768348 with identifier: AS79616
2026-03-28 05:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2a7e67c-4c78-5406-a70a-3e2ede768348 with identifier: AS79616
2026-03-28 05:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2a7e67c-4c78-5406-a70a-3e2ede768348 with identifier: AS79616 to the API
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:14:53Z',
 'fuel_type': 'petrol',
 'id': 'f2a7e67c-4c78-5406-a70a-3e2ede768348',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS79616',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 52043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 VTi Tendance',
 'transmission': 'automatic',
 'trim': 'Tendance',
 'year': 2012}
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Saving data for AS79616: {'auction_closing_time': 1774714493.0, 'created_time': 1774552674.253749, 'last_price_update_time': 1774676291.079176}
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS79616') HTTP/1.1" 204 0
2026-03-28 05:38:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: WS06439
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06439%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for WS06439: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for NJ52204: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: CH96061
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: VC90079
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for CK58457: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for HD80802: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: XR34915
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: VN57759
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: UF15161
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT08782%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for HT08782: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: XC12317
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC12317%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for XC12317: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: BD00645
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD00645%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for BD00645: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: AT89899
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: SL14548
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: DG30240
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: YF64568
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: UL26956
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL26956%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for UL26956: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for ET07412: 2
2026-03-28 05:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412
2026-03-28 05:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a070bd6-ea94-505e-870a-571a35627e97 with scrape type 2
2026-03-28 05:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a070bd6-ea94-505e-870a-571a35627e97 with scrape type 2
2026-03-28 05:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a070bd6-ea94-505e-870a-571a35627e97, identifier: ET07412
2026-03-28 05:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412
2026-03-28 05:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412
2026-03-28 05:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412 to the API
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-28T16:30:19Z',
 'fuel_type': 'petrol',
 'id': '4a070bd6-ea94-505e-870a-571a35627e97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET07412',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 125817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-12',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2017}
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Saving data for ET07412: {'auction_closing_time': 1774715419.0, 'created_time': 1774552568.559639, 'last_price_update_time': 1774676291.748448}
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET07412') HTTP/1.1" 204 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW73502%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for NW73502: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: JF45279
2026-03-28 05:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:12 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: CU51755
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: RC77177
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC77177%27 HTTP/1.1" 200 None
2026-03-28 05:38:12 [auto1.de] INFO: Scrape type for RC77177: 0
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: KM05428
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: TD03088
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD03088%27 HTTP/1.1" 200 None
2026-03-28 05:38:12 [auto1.de] INFO: Scrape type for TD03088: 0
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: JW61268
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: KB01548
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB01548%27 HTTP/1.1" 200 None
2026-03-28 05:38:12 [auto1.de] INFO: Scrape type for KB01548: 0
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: MY86649
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: YZ28815
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: HU07313
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: HN89991
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN89991%27 HTTP/1.1" 200 None
2026-03-28 05:38:12 [auto1.de] INFO: Scrape type for HN89991: 2
2026-03-28 05:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25bb7591-5aa6-529f-a1f3-6aa2cb2e21d9 with identifier: HN89991
2026-03-28 05:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25bb7591-5aa6-529f-a1f3-6aa2cb2e21d9 with scrape type 2
2026-03-28 05:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25bb7591-5aa6-529f-a1f3-6aa2cb2e21d9 with scrape type 2
2026-03-28 05:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25bb7591-5aa6-529f-a1f3-6aa2cb2e21d9, identifier: HN89991
2026-03-28 05:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25bb7591-5aa6-529f-a1f3-6aa2cb2e21d9 with identifier: HN89991
2026-03-28 05:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25bb7591-5aa6-529f-a1f3-6aa2cb2e21d9 with identifier: HN89991
2026-03-28 05:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25bb7591-5aa6-529f-a1f3-6aa2cb2e21d9 with identifier: HN89991 to the API
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:31:35Z',
 'fuel_type': 'diesel',
 'id': '25bb7591-5aa6-529f-a1f3-6aa2cb2e21d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN89991',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 65479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-25',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2019}
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN89991%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Saving data for HN89991: {'auction_closing_time': 1774715495.0, 'created_time': 1774466941.898171, 'last_price_update_time': 1774676293.465528}
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN89991') HTTP/1.1" 204 0
2026-03-28 05:38:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: MJ05239
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: FD71544
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD71544%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for FD71544: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for YT57989: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: FJ72421
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72421%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for FJ72421: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: LE12587
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE12587%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for LE12587: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for WD76267: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55119%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for KP55119: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: EG37222
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: LG15498
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: TL57176
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: HU45030
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: FM34812
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM34812%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for FM34812: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for SG67731: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: MH30608
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH30608%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for MH30608: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: CU73818
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU73818%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for CU73818: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for DW20402: 2
2026-03-28 05:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402
2026-03-28 05:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with scrape type 2
2026-03-28 05:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with scrape type 2
2026-03-28 05:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed, identifier: DW20402
2026-03-28 05:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402
2026-03-28 05:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402
2026-03-28 05:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402 to the API
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:36:52Z',
 'fuel_type': 'petrol',
 'id': '47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW20402',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 85484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-07',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2010}
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Saving data for DW20402: {'auction_closing_time': 1774715812.0, 'created_time': 1774551198.614287, 'last_price_update_time': 1774676294.190869}
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW20402') HTTP/1.1" 204 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: YB47144
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47144%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for YB47144: 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: WG55926
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG55926%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for WG55926: 2
2026-03-28 05:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 632d606b-c92f-5e32-bf55-eb01411e0431 with identifier: WG55926
2026-03-28 05:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 632d606b-c92f-5e32-bf55-eb01411e0431 with scrape type 2
2026-03-28 05:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 632d606b-c92f-5e32-bf55-eb01411e0431 with scrape type 2
2026-03-28 05:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 632d606b-c92f-5e32-bf55-eb01411e0431, identifier: WG55926
2026-03-28 05:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 632d606b-c92f-5e32-bf55-eb01411e0431 with identifier: WG55926
2026-03-28 05:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 632d606b-c92f-5e32-bf55-eb01411e0431 with identifier: WG55926
2026-03-28 05:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 632d606b-c92f-5e32-bf55-eb01411e0431 with identifier: WG55926 to the API
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:05:08Z',
 'fuel_type': 'petrol',
 'id': '632d606b-c92f-5e32-bf55-eb01411e0431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG55926',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 29036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-27',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2024}
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG55926%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Saving data for WG55926: {'auction_closing_time': 1774713908.0, 'created_time': 1774465503.820436, 'last_price_update_time': 1774676294.744957}
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG55926') HTTP/1.1" 204 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for AA30425: 2
2026-03-28 05:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425
2026-03-28 05:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23688e5d-ee29-5a73-87a8-f6f328163c0d with scrape type 2
2026-03-28 05:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23688e5d-ee29-5a73-87a8-f6f328163c0d with scrape type 2
2026-03-28 05:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23688e5d-ee29-5a73-87a8-f6f328163c0d, identifier: AA30425
2026-03-28 05:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425
2026-03-28 05:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425
2026-03-28 05:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425 to the API
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:28:50Z',
 'fuel_type': 'petrol',
 'id': '23688e5d-ee29-5a73-87a8-f6f328163c0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA30425',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 185160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-08',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-28 05:38:15 [auto1.de] INFO: Saving data for AA30425: {'auction_closing_time': 1774715330.0, 'created_time': 1773917341.392454, 'last_price_update_time': 1774676295.191068}
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA30425') HTTP/1.1" 204 0
2026-03-28 05:38:15 [auto1.de] INFO: Found listing with ID: HT53845
2026-03-28 05:38:15 [auto1.de] INFO: Found listing with ID: MF98327
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF98327%27 HTTP/1.1" 200 None
2026-03-28 05:38:15 [auto1.de] INFO: Scrape type for MF98327: 2
2026-03-28 05:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5040a1c8-fc51-554b-b5ad-776dad1ae1fe with identifier: MF98327
2026-03-28 05:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5040a1c8-fc51-554b-b5ad-776dad1ae1fe with scrape type 2
2026-03-28 05:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5040a1c8-fc51-554b-b5ad-776dad1ae1fe with scrape type 2
2026-03-28 05:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5040a1c8-fc51-554b-b5ad-776dad1ae1fe, identifier: MF98327
2026-03-28 05:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5040a1c8-fc51-554b-b5ad-776dad1ae1fe with identifier: MF98327
2026-03-28 05:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5040a1c8-fc51-554b-b5ad-776dad1ae1fe with identifier: MF98327
2026-03-28 05:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5040a1c8-fc51-554b-b5ad-776dad1ae1fe with identifier: MF98327 to the API
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:42:44Z',
 'fuel_type': 'petrol',
 'id': '5040a1c8-fc51-554b-b5ad-776dad1ae1fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF98327',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 191835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-30',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF98327%27 HTTP/1.1" 200 None
2026-03-28 05:38:15 [auto1.de] INFO: Saving data for MF98327: {'auction_closing_time': 1774716164.0, 'created_time': 1773304232.487485, 'last_price_update_time': 1774676295.653276}
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF98327') HTTP/1.1" 204 0
2026-03-28 05:38:15 [auto1.de] INFO: Found listing with ID: TR03247
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR03247%27 HTTP/1.1" 200 None
2026-03-28 05:38:15 [auto1.de] INFO: Scrape type for TR03247: 2
2026-03-28 05:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88eab396-edc0-50fd-a507-889595e6e4ea with identifier: TR03247
2026-03-28 05:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88eab396-edc0-50fd-a507-889595e6e4ea with scrape type 2
2026-03-28 05:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88eab396-edc0-50fd-a507-889595e6e4ea with scrape type 2
2026-03-28 05:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88eab396-edc0-50fd-a507-889595e6e4ea, identifier: TR03247
2026-03-28 05:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88eab396-edc0-50fd-a507-889595e6e4ea with identifier: TR03247
2026-03-28 05:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88eab396-edc0-50fd-a507-889595e6e4ea with identifier: TR03247
2026-03-28 05:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88eab396-edc0-50fd-a507-889595e6e4ea with identifier: TR03247 to the API
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:38Z',
 'fuel_type': 'petrol',
 'id': '88eab396-edc0-50fd-a507-889595e6e4ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR03247',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 40943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Business Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Start/Stop',
 'year': 2021}
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR03247%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Saving data for TR03247: {'auction_closing_time': 1774716038.0, 'created_time': 1774463628.333747, 'last_price_update_time': 1774676296.132025}
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR03247') HTTP/1.1" 204 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: CU78638
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: ED90812
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED90812%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for ED90812: 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for ZF63164: 2
2026-03-28 05:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af646335-8a1a-524c-af12-7483d0ac11e2 with identifier: ZF63164
2026-03-28 05:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af646335-8a1a-524c-af12-7483d0ac11e2 with scrape type 2
2026-03-28 05:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af646335-8a1a-524c-af12-7483d0ac11e2 with scrape type 2
2026-03-28 05:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af646335-8a1a-524c-af12-7483d0ac11e2, identifier: ZF63164
2026-03-28 05:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af646335-8a1a-524c-af12-7483d0ac11e2 with identifier: ZF63164
2026-03-28 05:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af646335-8a1a-524c-af12-7483d0ac11e2 with identifier: ZF63164
2026-03-28 05:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af646335-8a1a-524c-af12-7483d0ac11e2 with identifier: ZF63164 to the API
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:00:41Z',
 'fuel_type': 'petrol',
 'id': 'af646335-8a1a-524c-af12-7483d0ac11e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF63164',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 98907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-02',
 'seller_name': None,
 'title': 'Dacia Dokker 1.6 SCe Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2017}
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Saving data for ZF63164: {'auction_closing_time': 1774713641.0, 'created_time': 1774553046.294635, 'last_price_update_time': 1774676296.602278}
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF63164') HTTP/1.1" 204 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: DE00247
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE00247%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for DE00247: 0
2026-03-28 05:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:17 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for LR98326: 2
2026-03-28 05:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with identifier: LR98326
2026-03-28 05:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with scrape type 2
2026-03-28 05:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with scrape type 2
2026-03-28 05:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7, identifier: LR98326
2026-03-28 05:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with identifier: LR98326
2026-03-28 05:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with identifier: LR98326
2026-03-28 05:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with identifier: LR98326 to the API
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-28T16:09:41Z',
 'fuel_type': 'petrol',
 'id': '23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR98326',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XJ',
 'odometer': 292611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-16',
 'seller_name': None,
 'title': 'Jaguar XJ 3.0 V6 XJ6',
 'transmission': 'automatic',
 'trim': '6',
 'year': 2005}
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Saving data for LR98326: {'auction_closing_time': 1774714181.0, 'created_time': 1774550651.01163, 'last_price_update_time': 1774676297.569408}
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR98326') HTTP/1.1" 204 0
2026-03-28 05:38:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: DB10875
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: SW52819
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW52819%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for SW52819: 0
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: WK09344
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK09344%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for WK09344: 0
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: PK14357
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for NC06801: 2
2026-03-28 05:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801
2026-03-28 05:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97036840-b34f-5d4b-8251-e5a327b3ad4f with scrape type 2
2026-03-28 05:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97036840-b34f-5d4b-8251-e5a327b3ad4f with scrape type 2
2026-03-28 05:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97036840-b34f-5d4b-8251-e5a327b3ad4f, identifier: NC06801
2026-03-28 05:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801
2026-03-28 05:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801
2026-03-28 05:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801 to the API
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:08:38Z',
 'fuel_type': 'petrol',
 'id': '97036840-b34f-5d4b-8251-e5a327b3ad4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC06801',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 129074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-05',
 'seller_name': None,
 'title': 'Kia Venga 1.4 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2014}
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-28 05:38:18 [auto1.de] INFO: Saving data for NC06801: {'auction_closing_time': 1774714118.0, 'created_time': 1773228965.411348, 'last_price_update_time': 1774676298.036036}
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC06801') HTTP/1.1" 204 0
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: EJ26253
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ26253%27 HTTP/1.1" 200 None
2026-03-28 05:38:18 [auto1.de] INFO: Scrape type for EJ26253: 0
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: BZ18787
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: GP42203
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: NJ15905
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ15905%27 HTTP/1.1" 200 None
2026-03-28 05:38:18 [auto1.de] INFO: Scrape type for NJ15905: 0
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: GG24255
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: VE81778
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE81778%27 HTTP/1.1" 200 None
2026-03-28 05:38:18 [auto1.de] INFO: Scrape type for VE81778: 0
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-28 05:38:18 [auto1.de] INFO: Scrape type for BZ53185: 2
2026-03-28 05:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185
2026-03-28 05:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0166d2-96c1-5251-8dba-566ecfb302d7 with scrape type 2
2026-03-28 05:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a0166d2-96c1-5251-8dba-566ecfb302d7 with scrape type 2
2026-03-28 05:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a0166d2-96c1-5251-8dba-566ecfb302d7, identifier: BZ53185
2026-03-28 05:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185
2026-03-28 05:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185
2026-03-28 05:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185 to the API
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:39:10Z',
 'fuel_type': 'petrol',
 'id': '8a0166d2-96c1-5251-8dba-566ecfb302d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ53185',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 143387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-24',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-28 05:38:18 [auto1.de] INFO: Saving data for BZ53185: {'auction_closing_time': 1774715950.0, 'created_time': 1774552829.885699, 'last_price_update_time': 1774676298.600118}
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ53185') HTTP/1.1" 204 0
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: GV82392
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: MY91371
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-28 05:38:18 [auto1.de] INFO: Scrape type for JN55022: 0
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-28 05:38:18 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-28 05:38:18 [auto1.de] INFO: Scrape type for KU16473: 2
2026-03-28 05:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473
2026-03-28 05:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with scrape type 2
2026-03-28 05:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with scrape type 2
2026-03-28 05:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a, identifier: KU16473
2026-03-28 05:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473
2026-03-28 05:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473
2026-03-28 05:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473 to the API
2026-03-28 05:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:25:20Z',
 'fuel_type': 'petrol',
 'id': '493b1b3d-62e6-5c80-a9df-1c1a45fd667a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU16473',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 227149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-04',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T Classic',
 'transmission': 'automatic',
 'trim': 'T Classic',
 'year': 2005}
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-28 05:38:19 [auto1.de] INFO: Saving data for KU16473: {'auction_closing_time': 1774715120.0, 'created_time': 1774552710.887056, 'last_price_update_time': 1774676299.207723}
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU16473') HTTP/1.1" 204 0
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: BM91170
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: KH11075
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH11075%27 HTTP/1.1" 200 None
2026-03-28 05:38:19 [auto1.de] INFO: Scrape type for KH11075: 0
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: PW43450
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW43450%27 HTTP/1.1" 200 None
2026-03-28 05:38:19 [auto1.de] INFO: Scrape type for PW43450: 0
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: AA38462
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: TZ59540
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: UA38092
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA38092%27 HTTP/1.1" 200 None
2026-03-28 05:38:19 [auto1.de] INFO: Scrape type for UA38092: 0
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: SP61181
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: NG71684
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: LX58961
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX58961%27 HTTP/1.1" 200 None
2026-03-28 05:38:19 [auto1.de] INFO: Scrape type for LX58961: 0
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: CA26393
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC25701%27 HTTP/1.1" 200 None
2026-03-28 05:38:19 [auto1.de] INFO: Scrape type for WC25701: 2
2026-03-28 05:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701
2026-03-28 05:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with scrape type 2
2026-03-28 05:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with scrape type 2
2026-03-28 05:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da, identifier: WC25701
2026-03-28 05:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701
2026-03-28 05:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701
2026-03-28 05:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701 to the API
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:44:29Z',
 'fuel_type': 'diesel',
 'id': '51b87b72-a6a0-55bc-9521-d6aa3e99d4da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC25701',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 95598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-14',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2016}
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC25701%27 HTTP/1.1" 200 None
2026-03-28 05:38:19 [auto1.de] INFO: Saving data for WC25701: {'auction_closing_time': 1774716269.0, 'created_time': 1773138513.906347, 'last_price_update_time': 1774676299.750642}
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC25701') HTTP/1.1" 204 0
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: NZ09394
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ09394%27 HTTP/1.1" 200 None
2026-03-28 05:38:19 [auto1.de] INFO: Scrape type for NZ09394: 0
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-28 05:38:19 [auto1.de] INFO: Found listing with ID: RZ83508
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ83508%27 HTTP/1.1" 200 None
2026-03-28 05:38:19 [auto1.de] INFO: Scrape type for RZ83508: 0
2026-03-28 05:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:20 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:20 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-28 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-28 05:38:20 [auto1.de] INFO: Scrape type for NV84583: 0
2026-03-28 05:38:20 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-28 05:38:20 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-28 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-28 05:38:20 [auto1.de] INFO: Scrape type for DH44526: 0
2026-03-28 05:38:20 [auto1.de] INFO: Found listing with ID: ZL58365
2026-03-28 05:38:20 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-28 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-28 05:38:20 [auto1.de] INFO: Scrape type for TH77412: 0
2026-03-28 05:38:20 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-28 05:38:20 [auto1.de] INFO: Found listing with ID: CH57776
2026-03-28 05:38:20 [auto1.de] INFO: Found listing with ID: SE89354
2026-03-28 05:38:20 [auto1.de] INFO: Found listing with ID: FH51774
2026-03-28 05:38:20 [auto1.de] INFO: Found listing with ID: DF27266
2026-03-28 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF27266%27 HTTP/1.1" 200 None
2026-03-28 05:38:20 [auto1.de] INFO: Scrape type for DF27266: 2
2026-03-28 05:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f24cd6a5-2145-5426-8b11-11344f3e60f9 with identifier: DF27266
2026-03-28 05:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f24cd6a5-2145-5426-8b11-11344f3e60f9 with scrape type 2
2026-03-28 05:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f24cd6a5-2145-5426-8b11-11344f3e60f9 with scrape type 2
2026-03-28 05:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f24cd6a5-2145-5426-8b11-11344f3e60f9, identifier: DF27266
2026-03-28 05:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f24cd6a5-2145-5426-8b11-11344f3e60f9 with identifier: DF27266
2026-03-28 05:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f24cd6a5-2145-5426-8b11-11344f3e60f9 with identifier: DF27266
2026-03-28 05:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f24cd6a5-2145-5426-8b11-11344f3e60f9 with identifier: DF27266 to the API
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:10:19Z',
 'fuel_type': 'petrol',
 'id': 'f24cd6a5-2145-5426-8b11-11344f3e60f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF27266',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 165162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CGI T BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2013}
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF27266%27 HTTP/1.1" 200 None
2026-03-28 05:38:21 [auto1.de] INFO: Saving data for DF27266: {'auction_closing_time': 1774714219.0, 'created_time': 1774552941.594063, 'last_price_update_time': 1774676301.372152}
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF27266') HTTP/1.1" 204 0
2026-03-28 05:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:21 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-28 05:38:21 [auto1.de] INFO: Found listing with ID: ZZ35874
2026-03-28 05:38:21 [auto1.de] INFO: Found listing with ID: TK74975
2026-03-28 05:38:21 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-28 05:38:21 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-28 05:38:21 [auto1.de] INFO: Scrape type for NP64585: 2
2026-03-28 05:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585
2026-03-28 05:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with scrape type 2
2026-03-28 05:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with scrape type 2
2026-03-28 05:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 321b5b8f-6920-59cf-91f0-bb473f4d9d82, identifier: NP64585
2026-03-28 05:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585
2026-03-28 05:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585
2026-03-28 05:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585 to the API
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:18:48Z',
 'fuel_type': 'diesel',
 'id': '321b5b8f-6920-59cf-91f0-bb473f4d9d82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP64585',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 115054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-22',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC',
 'transmission': 'manual',
 'trim': 'BlueTEC',
 'year': 2015}
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-28 05:38:21 [auto1.de] INFO: Saving data for NP64585: {'auction_closing_time': 1774714728.0, 'created_time': 1774550722.680514, 'last_price_update_time': 1774676301.925059}
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP64585') HTTP/1.1" 204 0
2026-03-28 05:38:21 [auto1.de] INFO: Found listing with ID: VH79690
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH79690%27 HTTP/1.1" 200 None
2026-03-28 05:38:21 [auto1.de] INFO: Scrape type for VH79690: 0
2026-03-28 05:38:21 [auto1.de] INFO: Found listing with ID: DM73323
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM73323%27 HTTP/1.1" 200 None
2026-03-28 05:38:21 [auto1.de] INFO: Scrape type for DM73323: 0
2026-03-28 05:38:21 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-28 05:38:21 [auto1.de] INFO: Found listing with ID: LZ19661
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ19661%27 HTTP/1.1" 200 None
2026-03-28 05:38:21 [auto1.de] INFO: Scrape type for LZ19661: 0
2026-03-28 05:38:21 [auto1.de] INFO: Found listing with ID: ZA98026
2026-03-28 05:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA98026%27 HTTP/1.1" 200 None
2026-03-28 05:38:22 [auto1.de] INFO: Scrape type for ZA98026: 0
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: TJ01230
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ01230%27 HTTP/1.1" 200 None
2026-03-28 05:38:22 [auto1.de] INFO: Scrape type for TJ01230: 0
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: CE41474
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: DD25870
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: LF82683
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF82683%27 HTTP/1.1" 200 None
2026-03-28 05:38:22 [auto1.de] INFO: Scrape type for LF82683: 0
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-28 05:38:22 [auto1.de] INFO: Scrape type for HB06049: 0
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: TA27217
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY60106%27 HTTP/1.1" 200 None
2026-03-28 05:38:22 [auto1.de] INFO: Scrape type for LY60106: 0
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: AR87733
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: YC79153
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC79153%27 HTTP/1.1" 200 None
2026-03-28 05:38:22 [auto1.de] INFO: Scrape type for YC79153: 2
2026-03-28 05:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21252cbc-c639-5c2e-abd5-80c8d508c02b with identifier: YC79153
2026-03-28 05:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21252cbc-c639-5c2e-abd5-80c8d508c02b with scrape type 2
2026-03-28 05:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21252cbc-c639-5c2e-abd5-80c8d508c02b with scrape type 2
2026-03-28 05:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21252cbc-c639-5c2e-abd5-80c8d508c02b, identifier: YC79153
2026-03-28 05:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21252cbc-c639-5c2e-abd5-80c8d508c02b with identifier: YC79153
2026-03-28 05:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21252cbc-c639-5c2e-abd5-80c8d508c02b with identifier: YC79153
2026-03-28 05:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21252cbc-c639-5c2e-abd5-80c8d508c02b with identifier: YC79153 to the API
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:08:28Z',
 'fuel_type': 'diesel',
 'id': '21252cbc-c639-5c2e-abd5-80c8d508c02b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC79153',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 68943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-03',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2013}
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC79153%27 HTTP/1.1" 200 None
2026-03-28 05:38:22 [auto1.de] INFO: Saving data for YC79153: {'auction_closing_time': 1774714108.0, 'created_time': 1773226429.583706, 'last_price_update_time': 1774676302.505969}
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC79153') HTTP/1.1" 204 0
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC94975%27 HTTP/1.1" 200 None
2026-03-28 05:38:22 [auto1.de] INFO: Scrape type for GC94975: 0
2026-03-28 05:38:22 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-28 05:38:22 [auto1.de] INFO: Scrape type for AH65179: 2
2026-03-28 05:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179
2026-03-28 05:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with scrape type 2
2026-03-28 05:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with scrape type 2
2026-03-28 05:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9, identifier: AH65179
2026-03-28 05:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179
2026-03-28 05:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179
2026-03-28 05:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179 to the API
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:40:31Z',
 'fuel_type': 'diesel',
 'id': '67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH65179',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 58734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2019}
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-28 05:38:23 [auto1.de] INFO: Saving data for AH65179: {'auction_closing_time': 1774716031.0, 'created_time': 1774552745.370481, 'last_price_update_time': 1774676303.042221}
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH65179') HTTP/1.1" 204 0
2026-03-28 05:38:23 [auto1.de] INFO: Found listing with ID: FW46825
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW46825%27 HTTP/1.1" 200 None
2026-03-28 05:38:23 [auto1.de] INFO: Scrape type for FW46825: 2
2026-03-28 05:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dff175b-984f-554f-a1a6-57896e4316ea with identifier: FW46825
2026-03-28 05:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dff175b-984f-554f-a1a6-57896e4316ea with scrape type 2
2026-03-28 05:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dff175b-984f-554f-a1a6-57896e4316ea with scrape type 2
2026-03-28 05:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1dff175b-984f-554f-a1a6-57896e4316ea, identifier: FW46825
2026-03-28 05:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1dff175b-984f-554f-a1a6-57896e4316ea with identifier: FW46825
2026-03-28 05:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1dff175b-984f-554f-a1a6-57896e4316ea with identifier: FW46825
2026-03-28 05:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1dff175b-984f-554f-a1a6-57896e4316ea with identifier: FW46825 to the API
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:06:41Z',
 'fuel_type': 'diesel',
 'id': '1dff175b-984f-554f-a1a6-57896e4316ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW46825',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 240189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-04',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 313 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW46825%27 HTTP/1.1" 200 None
2026-03-28 05:38:23 [auto1.de] INFO: Saving data for FW46825: {'auction_closing_time': 1774714001.0, 'created_time': 1773135666.192678, 'last_price_update_time': 1774676303.497618}
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW46825') HTTP/1.1" 204 0
2026-03-28 05:38:23 [auto1.de] INFO: Found listing with ID: VA68941
2026-03-28 05:38:23 [auto1.de] INFO: Found listing with ID: XE63092
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE63092%27 HTTP/1.1" 200 None
2026-03-28 05:38:23 [auto1.de] INFO: Scrape type for XE63092: 0
2026-03-28 05:38:23 [auto1.de] INFO: Found listing with ID: DN95746
2026-03-28 05:38:23 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-28 05:38:23 [auto1.de] INFO: Found listing with ID: VS28124
2026-03-28 05:38:23 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-28 05:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:24 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: GL70534
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: CH21169
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH21169%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Scrape type for CH21169: 0
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: KA16702
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA16702%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Scrape type for KA16702: 0
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: UU48969
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL19889%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Scrape type for EL19889: 0
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: BS54687
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS54687%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Scrape type for BS54687: 0
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Scrape type for EW11176: 0
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA95549%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Scrape type for KA95549: 0
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: EP28641
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP28641%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Scrape type for EP28641: 0
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: UU77813
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: RB36890
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB36890%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Scrape type for RB36890: 0
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: FX70988
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX70988%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Scrape type for FX70988: 0
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: RT58189
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: MD90322
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD90322%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Scrape type for MD90322: 0
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: UM54862
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: HD53184
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-28 05:38:24 [auto1.de] INFO: Found listing with ID: UZ83781
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ83781%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Scrape type for UZ83781: 2
2026-03-28 05:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d35c6f4-fbc5-55f2-989b-093e78ac50b4 with identifier: UZ83781
2026-03-28 05:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d35c6f4-fbc5-55f2-989b-093e78ac50b4 with scrape type 2
2026-03-28 05:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d35c6f4-fbc5-55f2-989b-093e78ac50b4 with scrape type 2
2026-03-28 05:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d35c6f4-fbc5-55f2-989b-093e78ac50b4, identifier: UZ83781
2026-03-28 05:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d35c6f4-fbc5-55f2-989b-093e78ac50b4 with identifier: UZ83781
2026-03-28 05:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d35c6f4-fbc5-55f2-989b-093e78ac50b4 with identifier: UZ83781
2026-03-28 05:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d35c6f4-fbc5-55f2-989b-093e78ac50b4 with identifier: UZ83781 to the API
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 421,
 'expiration_date': '2026-03-28T16:03:40Z',
 'fuel_type': 'petrol',
 'id': '9d35c6f4-fbc5-55f2-989b-093e78ac50b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ83781',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 29474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-07',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG S 4Matic',
 'transmission': 'automatic',
 'trim': 'S 4Matic',
 'year': 2021}
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ83781%27 HTTP/1.1" 200 None
2026-03-28 05:38:24 [auto1.de] INFO: Saving data for UZ83781: {'auction_closing_time': 1774713820.0, 'created_time': 1774466424.529065, 'last_price_update_time': 1774676304.978021}
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ83781') HTTP/1.1" 204 0
2026-03-28 05:38:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:25 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-28 05:38:25 [auto1.de] INFO: Found listing with ID: ZY59187
2026-03-28 05:38:25 [auto1.de] INFO: Found listing with ID: NZ57035
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ57035%27 HTTP/1.1" 200 None
2026-03-28 05:38:25 [auto1.de] INFO: Scrape type for NZ57035: 0
2026-03-28 05:38:25 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-28 05:38:25 [auto1.de] INFO: Scrape type for RW93776: 2
2026-03-28 05:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e8101ca-0c25-56ac-a33f-8024d6a8340b with identifier: RW93776
2026-03-28 05:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8101ca-0c25-56ac-a33f-8024d6a8340b with scrape type 2
2026-03-28 05:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e8101ca-0c25-56ac-a33f-8024d6a8340b with scrape type 2
2026-03-28 05:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e8101ca-0c25-56ac-a33f-8024d6a8340b, identifier: RW93776
2026-03-28 05:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e8101ca-0c25-56ac-a33f-8024d6a8340b with identifier: RW93776
2026-03-28 05:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e8101ca-0c25-56ac-a33f-8024d6a8340b with identifier: RW93776
2026-03-28 05:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e8101ca-0c25-56ac-a33f-8024d6a8340b with identifier: RW93776 to the API
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:00:39Z',
 'fuel_type': 'petrol',
 'id': '4e8101ca-0c25-56ac-a33f-8024d6a8340b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW93776',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 126247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-02',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2018}
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-28 05:38:25 [auto1.de] INFO: Saving data for RW93776: {'auction_closing_time': 1774713639.0, 'created_time': 1774552100.884535, 'last_price_update_time': 1774676305.525345}
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW93776') HTTP/1.1" 204 0
2026-03-28 05:38:25 [auto1.de] INFO: Found listing with ID: SY82090
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY82090%27 HTTP/1.1" 200 None
2026-03-28 05:38:25 [auto1.de] INFO: Scrape type for SY82090: 0
2026-03-28 05:38:25 [auto1.de] INFO: Found listing with ID: UA55919
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA55919%27 HTTP/1.1" 200 None
2026-03-28 05:38:25 [auto1.de] INFO: Scrape type for UA55919: 0
2026-03-28 05:38:25 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC02535%27 HTTP/1.1" 200 None
2026-03-28 05:38:25 [auto1.de] INFO: Scrape type for YC02535: 0
2026-03-28 05:38:25 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-28 05:38:25 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-28 05:38:25 [auto1.de] INFO: Scrape type for XS74936: 0
2026-03-28 05:38:25 [auto1.de] INFO: Found listing with ID: UU45926
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU45926%27 HTTP/1.1" 200 None
2026-03-28 05:38:25 [auto1.de] INFO: Scrape type for UU45926: 2
2026-03-28 05:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4095058-c07c-5cb6-9fa9-dcf00af539b9 with identifier: UU45926
2026-03-28 05:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4095058-c07c-5cb6-9fa9-dcf00af539b9 with scrape type 2
2026-03-28 05:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4095058-c07c-5cb6-9fa9-dcf00af539b9 with scrape type 2
2026-03-28 05:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4095058-c07c-5cb6-9fa9-dcf00af539b9, identifier: UU45926
2026-03-28 05:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4095058-c07c-5cb6-9fa9-dcf00af539b9 with identifier: UU45926
2026-03-28 05:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4095058-c07c-5cb6-9fa9-dcf00af539b9 with identifier: UU45926
2026-03-28 05:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4095058-c07c-5cb6-9fa9-dcf00af539b9 with identifier: UU45926 to the API
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:03:26Z',
 'fuel_type': 'petrol',
 'id': 'e4095058-c07c-5cb6-9fa9-dcf00af539b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU45926',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 138149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-21',
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU45926%27 HTTP/1.1" 200 None
2026-03-28 05:38:26 [auto1.de] INFO: Saving data for UU45926: {'auction_closing_time': 1774713806.0, 'created_time': 1774466190.302255, 'last_price_update_time': 1774676306.096581}
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU45926') HTTP/1.1" 204 0
2026-03-28 05:38:26 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-28 05:38:26 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-28 05:38:26 [auto1.de] INFO: Found listing with ID: HL68502
2026-03-28 05:38:26 [auto1.de] INFO: Found listing with ID: FS10993
2026-03-28 05:38:26 [auto1.de] INFO: Found listing with ID: DY94514
2026-03-28 05:38:26 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC68587%27 HTTP/1.1" 200 None
2026-03-28 05:38:26 [auto1.de] INFO: Scrape type for RC68587: 0
2026-03-28 05:38:26 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-28 05:38:26 [auto1.de] INFO: Scrape type for XV87595: 2
2026-03-28 05:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595
2026-03-28 05:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa861509-4fca-5463-aa04-17cd6dea1c8a with scrape type 2
2026-03-28 05:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa861509-4fca-5463-aa04-17cd6dea1c8a with scrape type 2
2026-03-28 05:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa861509-4fca-5463-aa04-17cd6dea1c8a, identifier: XV87595
2026-03-28 05:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595
2026-03-28 05:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595
2026-03-28 05:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595 to the API
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:52:33Z',
 'fuel_type': 'petrol',
 'id': 'aa861509-4fca-5463-aa04-17cd6dea1c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV87595',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 51733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2016}
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-28 05:38:26 [auto1.de] INFO: Saving data for XV87595: {'auction_closing_time': 1774716753.0, 'created_time': 1774552739.401406, 'last_price_update_time': 1774676306.538685}
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV87595') HTTP/1.1" 204 0
2026-03-28 05:38:26 [auto1.de] INFO: Found listing with ID: VU63720
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU63720%27 HTTP/1.1" 200 None
2026-03-28 05:38:26 [auto1.de] INFO: Scrape type for VU63720: 0
2026-03-28 05:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:27 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:27 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-28 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73293%27 HTTP/1.1" 200 None
2026-03-28 05:38:27 [auto1.de] INFO: Scrape type for MR73293: 0
2026-03-28 05:38:27 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-28 05:38:27 [auto1.de] INFO: Found listing with ID: UM42416
2026-03-28 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM42416%27 HTTP/1.1" 200 None
2026-03-28 05:38:27 [auto1.de] INFO: Scrape type for UM42416: 0
2026-03-28 05:38:27 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-28 05:38:27 [auto1.de] INFO: Found listing with ID: XR09135
2026-03-28 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR09135%27 HTTP/1.1" 200 None
2026-03-28 05:38:27 [auto1.de] INFO: Scrape type for XR09135: 2
2026-03-28 05:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fb56454-4064-584a-91f5-add43b2d0c0f with identifier: XR09135
2026-03-28 05:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fb56454-4064-584a-91f5-add43b2d0c0f with scrape type 2
2026-03-28 05:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fb56454-4064-584a-91f5-add43b2d0c0f with scrape type 2
2026-03-28 05:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fb56454-4064-584a-91f5-add43b2d0c0f, identifier: XR09135
2026-03-28 05:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fb56454-4064-584a-91f5-add43b2d0c0f with identifier: XR09135
2026-03-28 05:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fb56454-4064-584a-91f5-add43b2d0c0f with identifier: XR09135
2026-03-28 05:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fb56454-4064-584a-91f5-add43b2d0c0f with identifier: XR09135 to the API
2026-03-28 05:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:02:33Z',
 'fuel_type': 'petrol',
 'id': '6fb56454-4064-584a-91f5-add43b2d0c0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR09135',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 172321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Cup Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup Sport & Style BlueMotion Tech',
 'year': 2014}
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR09135%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Saving data for XR09135: {'auction_closing_time': 1774713753.0, 'created_time': 1773229783.673298, 'last_price_update_time': 1774676308.119903}
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR09135') HTTP/1.1" 204 0
2026-03-28 05:38:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: BK51387
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for RE06888: 2
2026-03-28 05:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888
2026-03-28 05:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d18c2ef2-1803-574c-94da-7ec485fa67d7 with scrape type 2
2026-03-28 05:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d18c2ef2-1803-574c-94da-7ec485fa67d7 with scrape type 2
2026-03-28 05:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d18c2ef2-1803-574c-94da-7ec485fa67d7, identifier: RE06888
2026-03-28 05:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888
2026-03-28 05:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888
2026-03-28 05:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888 to the API
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:18Z',
 'fuel_type': 'petrol',
 'id': 'd18c2ef2-1803-574c-94da-7ec485fa67d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE06888',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 74009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-28',
 'seller_name': None,
 'title': 'Audi Q3 35 TFSI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2019}
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Saving data for RE06888: {'auction_closing_time': 1774715538.0, 'created_time': 1774552734.545828, 'last_price_update_time': 1774676308.530176}
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE06888') HTTP/1.1" 204 0
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: HV36396
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV36396%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for HV36396: 0
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: MR55647
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR55647%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for MR55647: 0
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: ET88076
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: JJ41566
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41566%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for JJ41566: 0
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP29277%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for RP29277: 0
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: HC23327
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC23327%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for HC23327: 0
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: ZF79989
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF79989%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for ZF79989: 0
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for RG74932: 2
2026-03-28 05:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932
2026-03-28 05:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with scrape type 2
2026-03-28 05:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with scrape type 2
2026-03-28 05:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3be55d76-3f10-5cd1-93f4-0831693ac6b0, identifier: RG74932
2026-03-28 05:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932
2026-03-28 05:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932
2026-03-28 05:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932 to the API
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:23:32Z',
 'fuel_type': 'petrol',
 'id': '3be55d76-3f10-5cd1-93f4-0831693ac6b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG74932',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 232113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-25',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2011}
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Saving data for RG74932: {'auction_closing_time': 1774715012.0, 'created_time': 1774551877.545696, 'last_price_update_time': 1774676309.098548}
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG74932') HTTP/1.1" 204 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: MY79031
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: YC90372
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC90372%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for YC90372: 2
2026-03-28 05:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61c87a2d-4821-5ea3-bf39-5e5b1451667c with identifier: YC90372
2026-03-28 05:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61c87a2d-4821-5ea3-bf39-5e5b1451667c with scrape type 2
2026-03-28 05:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61c87a2d-4821-5ea3-bf39-5e5b1451667c with scrape type 2
2026-03-28 05:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61c87a2d-4821-5ea3-bf39-5e5b1451667c, identifier: YC90372
2026-03-28 05:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61c87a2d-4821-5ea3-bf39-5e5b1451667c with identifier: YC90372
2026-03-28 05:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61c87a2d-4821-5ea3-bf39-5e5b1451667c with identifier: YC90372
2026-03-28 05:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61c87a2d-4821-5ea3-bf39-5e5b1451667c with identifier: YC90372 to the API
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:34:24Z',
 'fuel_type': 'diesel',
 'id': '61c87a2d-4821-5ea3-bf39-5e5b1451667c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC90372',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 334222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-23',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2012}
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC90372%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Saving data for YC90372: {'auction_closing_time': 1774715664.0, 'created_time': 1774552628.82619, 'last_price_update_time': 1774676309.654583}
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC90372') HTTP/1.1" 204 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: LL58658
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL58658%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for LL58658: 2
2026-03-28 05:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 721f18f5-8091-5291-b379-f3f2e5a60ed8 with identifier: LL58658
2026-03-28 05:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 721f18f5-8091-5291-b379-f3f2e5a60ed8 with scrape type 2
2026-03-28 05:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 721f18f5-8091-5291-b379-f3f2e5a60ed8 with scrape type 2
2026-03-28 05:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 721f18f5-8091-5291-b379-f3f2e5a60ed8, identifier: LL58658
2026-03-28 05:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 721f18f5-8091-5291-b379-f3f2e5a60ed8 with identifier: LL58658
2026-03-28 05:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 721f18f5-8091-5291-b379-f3f2e5a60ed8 with identifier: LL58658
2026-03-28 05:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 721f18f5-8091-5291-b379-f3f2e5a60ed8 with identifier: LL58658 to the API
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:51:14Z',
 'fuel_type': 'petrol',
 'id': '721f18f5-8091-5291-b379-f3f2e5a60ed8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL58658',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 52619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-18',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL58658%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Saving data for LL58658: {'auction_closing_time': 1774716674.0, 'created_time': 1774463931.480227, 'last_price_update_time': 1774676310.107502}
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL58658') HTTP/1.1" 204 0
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: LF42462
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: DD19418
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD19418%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Scrape type for DD19418: 0
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: TF24039
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE29735%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Scrape type for FE29735: 0
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Scrape type for MA41049: 2
2026-03-28 05:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049
2026-03-28 05:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6f7744-257d-5670-8a10-caf34f145406 with scrape type 2
2026-03-28 05:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f6f7744-257d-5670-8a10-caf34f145406 with scrape type 2
2026-03-28 05:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f6f7744-257d-5670-8a10-caf34f145406, identifier: MA41049
2026-03-28 05:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049
2026-03-28 05:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049
2026-03-28 05:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049 to the API
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:46:36Z',
 'fuel_type': 'diesel',
 'id': '0f6f7744-257d-5670-8a10-caf34f145406',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA41049',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 109518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-06',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Saving data for MA41049: {'auction_closing_time': 1774716396.0, 'created_time': 1774552850.297774, 'last_price_update_time': 1774676310.595266}
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA41049') HTTP/1.1" 204 0
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: HH04688
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: JV58210
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: AK28209
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: SL68511
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: PM76396
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG82717%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Scrape type for UG82717: 0
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: PN06461
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: KR96778
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR96778%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Scrape type for KR96778: 0
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: YR27652
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR27652%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Scrape type for YR27652: 0
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: WP16305
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: KW34660
2026-03-28 05:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:31 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:31 [auto1.de] INFO: Found listing with ID: KC21551
2026-03-28 05:38:31 [auto1.de] INFO: Found listing with ID: XN24576
2026-03-28 05:38:31 [auto1.de] INFO: Found listing with ID: GJ45514
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ45514%27 HTTP/1.1" 200 None
2026-03-28 05:38:31 [auto1.de] INFO: Scrape type for GJ45514: 2
2026-03-28 05:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 686e8272-9abc-5163-809c-4192035aaccc with identifier: GJ45514
2026-03-28 05:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 686e8272-9abc-5163-809c-4192035aaccc with scrape type 2
2026-03-28 05:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 686e8272-9abc-5163-809c-4192035aaccc with scrape type 2
2026-03-28 05:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 686e8272-9abc-5163-809c-4192035aaccc, identifier: GJ45514
2026-03-28 05:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 686e8272-9abc-5163-809c-4192035aaccc with identifier: GJ45514
2026-03-28 05:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 686e8272-9abc-5163-809c-4192035aaccc with identifier: GJ45514
2026-03-28 05:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 686e8272-9abc-5163-809c-4192035aaccc with identifier: GJ45514 to the API
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:01Z',
 'fuel_type': 'diesel',
 'id': '686e8272-9abc-5163-809c-4192035aaccc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ45514',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 255596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-30',
 'seller_name': None,
 'title': 'Renault Espace 2.0 dCi Navitech',
 'transmission': 'automatic',
 'trim': 'Navitech',
 'year': 2010}
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ45514%27 HTTP/1.1" 200 None
2026-03-28 05:38:31 [auto1.de] INFO: Saving data for GJ45514: {'auction_closing_time': 1774714861.0, 'created_time': 1774466081.313652, 'last_price_update_time': 1774676311.872925}
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ45514') HTTP/1.1" 204 0
2026-03-28 05:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:31 [auto1.de] INFO: Found listing with ID: GE52020
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE52020%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for GE52020: 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for DR31322: 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for GH26905: 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: NZ42181
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ42181%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for NZ42181: 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for KA69017: 2
2026-03-28 05:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 268e21d8-b8eb-570b-a920-528ea7b04035 with identifier: KA69017
2026-03-28 05:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 268e21d8-b8eb-570b-a920-528ea7b04035 with scrape type 2
2026-03-28 05:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 268e21d8-b8eb-570b-a920-528ea7b04035 with scrape type 2
2026-03-28 05:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 268e21d8-b8eb-570b-a920-528ea7b04035, identifier: KA69017
2026-03-28 05:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 268e21d8-b8eb-570b-a920-528ea7b04035 with identifier: KA69017
2026-03-28 05:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 268e21d8-b8eb-570b-a920-528ea7b04035 with identifier: KA69017
2026-03-28 05:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 268e21d8-b8eb-570b-a920-528ea7b04035 with identifier: KA69017 to the API
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:28Z',
 'fuel_type': 'diesel',
 'id': '268e21d8-b8eb-570b-a920-528ea7b04035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA69017',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 77867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-03',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Saving data for KA69017: {'auction_closing_time': 1774713748.0, 'created_time': 1774552442.726586, 'last_price_update_time': 1774676312.462942}
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA69017') HTTP/1.1" 204 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: ED62579
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED62579%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for ED62579: 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: XE48983
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: AT80326
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB66964%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for HB66964: 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: PY74539
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: NR20309
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: NS28302
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS28302%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for NS28302: 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: JU00246
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU00246%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for JU00246: 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: VB81192
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: WN39089
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39089%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for WN39089: 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: DC41283
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC41283%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for DC41283: 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: AM54247
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: DT97256
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT97256%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for DT97256: 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: BE84221
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for AK43100: 2
2026-03-28 05:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100
2026-03-28 05:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2903661-63dd-5386-916d-5dac2dd0550f with scrape type 2
2026-03-28 05:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2903661-63dd-5386-916d-5dac2dd0550f with scrape type 2
2026-03-28 05:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2903661-63dd-5386-916d-5dac2dd0550f, identifier: AK43100
2026-03-28 05:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100
2026-03-28 05:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100
2026-03-28 05:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100 to the API
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:29:07Z',
 'fuel_type': 'petrol',
 'id': 'c2903661-63dd-5386-916d-5dac2dd0550f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK43100',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 183209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Urban Move',
 'transmission': 'manual',
 'trim': 'Urban Move',
 'year': 2011}
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-28 05:38:33 [auto1.de] INFO: Saving data for AK43100: {'auction_closing_time': 1774715347.0, 'created_time': 1774552731.178961, 'last_price_update_time': 1774676313.026833}
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK43100') HTTP/1.1" 204 0
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: WR86078
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: YR83365
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: AM86665
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-28 05:38:33 [auto1.de] INFO: Scrape type for LA66980: 0
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: SP65010
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP65010%27 HTTP/1.1" 200 None
2026-03-28 05:38:33 [auto1.de] INFO: Scrape type for SP65010: 0
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: NL78703
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL78703%27 HTTP/1.1" 200 None
2026-03-28 05:38:33 [auto1.de] INFO: Scrape type for NL78703: 2
2026-03-28 05:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c18b52d-dc1d-51eb-95b0-ac0925593cd4 with identifier: NL78703
2026-03-28 05:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c18b52d-dc1d-51eb-95b0-ac0925593cd4 with scrape type 2
2026-03-28 05:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c18b52d-dc1d-51eb-95b0-ac0925593cd4 with scrape type 2
2026-03-28 05:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c18b52d-dc1d-51eb-95b0-ac0925593cd4, identifier: NL78703
2026-03-28 05:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c18b52d-dc1d-51eb-95b0-ac0925593cd4 with identifier: NL78703
2026-03-28 05:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c18b52d-dc1d-51eb-95b0-ac0925593cd4 with identifier: NL78703
2026-03-28 05:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c18b52d-dc1d-51eb-95b0-ac0925593cd4 with identifier: NL78703 to the API
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:49:54Z',
 'fuel_type': 'petrol',
 'id': '2c18b52d-dc1d-51eb-95b0-ac0925593cd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL78703',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 134070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-27',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2007}
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL78703%27 HTTP/1.1" 200 None
2026-03-28 05:38:33 [auto1.de] INFO: Saving data for NL78703: {'auction_closing_time': 1774716594.0, 'created_time': 1773662034.472653, 'last_price_update_time': 1774676313.594523}
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL78703') HTTP/1.1" 204 0
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: VB40979
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40979%27 HTTP/1.1" 200 None
2026-03-28 05:38:33 [auto1.de] INFO: Scrape type for VB40979: 0
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-28 05:38:33 [auto1.de] INFO: Scrape type for XC86778: 0
2026-03-28 05:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:34 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: FT42679
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: VJ42576
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ42576%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Scrape type for VJ42576: 0
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: JR79964
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: KP25975
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP25975%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Scrape type for KP25975: 0
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: VF94022
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF94022%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Scrape type for VF94022: 0
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: ZX49680
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX49680%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Scrape type for ZX49680: 2
2026-03-28 05:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caf30219-7dc7-5252-8405-b07121e69e59 with identifier: ZX49680
2026-03-28 05:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caf30219-7dc7-5252-8405-b07121e69e59 with scrape type 2
2026-03-28 05:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caf30219-7dc7-5252-8405-b07121e69e59 with scrape type 2
2026-03-28 05:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caf30219-7dc7-5252-8405-b07121e69e59, identifier: ZX49680
2026-03-28 05:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caf30219-7dc7-5252-8405-b07121e69e59 with identifier: ZX49680
2026-03-28 05:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caf30219-7dc7-5252-8405-b07121e69e59 with identifier: ZX49680
2026-03-28 05:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caf30219-7dc7-5252-8405-b07121e69e59 with identifier: ZX49680 to the API
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:15:52Z',
 'fuel_type': 'diesel',
 'id': 'caf30219-7dc7-5252-8405-b07121e69e59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX49680',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 California',
 'odometer': 310197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-19',
 'seller_name': None,
 'title': 'Volkswagen T5 California 2.5 TDI Comfortline Aufstelldach',
 'transmission': 'manual',
 'trim': 'Comfortline Aufstelldach',
 'year': 2007}
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX49680%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Saving data for ZX49680: {'auction_closing_time': 1774714552.0, 'created_time': 1774466223.08622, 'last_price_update_time': 1774676315.191741}
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX49680') HTTP/1.1" 204 0
2026-03-28 05:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: AT96377
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT96377%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Scrape type for AT96377: 2
2026-03-28 05:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb57f75b-01fc-50be-bb61-a75d13eae787 with identifier: AT96377
2026-03-28 05:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb57f75b-01fc-50be-bb61-a75d13eae787 with scrape type 2
2026-03-28 05:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb57f75b-01fc-50be-bb61-a75d13eae787 with scrape type 2
2026-03-28 05:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb57f75b-01fc-50be-bb61-a75d13eae787, identifier: AT96377
2026-03-28 05:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb57f75b-01fc-50be-bb61-a75d13eae787 with identifier: AT96377
2026-03-28 05:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb57f75b-01fc-50be-bb61-a75d13eae787 with identifier: AT96377
2026-03-28 05:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb57f75b-01fc-50be-bb61-a75d13eae787 with identifier: AT96377 to the API
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:59:51Z',
 'fuel_type': 'petrol',
 'id': 'cb57f75b-01fc-50be-bb61-a75d13eae787',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT96377',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 101546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT96377%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Saving data for AT96377: {'auction_closing_time': 1774717191.0, 'created_time': 1774463744.181746, 'last_price_update_time': 1774676315.723408}
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT96377') HTTP/1.1" 204 0
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: TW53975
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW53975%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Scrape type for TW53975: 0
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: KB02253
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: ZJ32938
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Scrape type for HJ62454: 2
2026-03-28 05:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454
2026-03-28 05:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with scrape type 2
2026-03-28 05:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with scrape type 2
2026-03-28 05:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea, identifier: HJ62454
2026-03-28 05:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454
2026-03-28 05:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454
2026-03-28 05:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454 to the API
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:57:41Z',
 'fuel_type': 'petrol',
 'id': '0fb819b1-bcbb-53c1-9118-e2454fcc35ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ62454',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 101089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-02',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2017}
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Saving data for HJ62454: {'auction_closing_time': 1774717061.0, 'created_time': 1774552633.56325, 'last_price_update_time': 1774676316.194701}
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ62454') HTTP/1.1" 204 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: AY57867
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: KC97074
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC97074%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for KC97074: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: VR22354
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: BS18146
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: TG31378
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: CJ76479
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: LS64729
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS64729%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for LS64729: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: MD90588
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD90588%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for MD90588: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for LN11604: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: AM47458
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: WF14643
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: FE81350
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: PF91020
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF91020%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for PF91020: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: EC31076
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for GG35295: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: KL04932
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL04932%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for KL04932: 2
2026-03-28 05:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fc9b844-606d-52ac-9544-55537c0a8c32 with identifier: KL04932
2026-03-28 05:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc9b844-606d-52ac-9544-55537c0a8c32 with scrape type 2
2026-03-28 05:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fc9b844-606d-52ac-9544-55537c0a8c32 with scrape type 2
2026-03-28 05:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fc9b844-606d-52ac-9544-55537c0a8c32, identifier: KL04932
2026-03-28 05:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fc9b844-606d-52ac-9544-55537c0a8c32 with identifier: KL04932
2026-03-28 05:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fc9b844-606d-52ac-9544-55537c0a8c32 with identifier: KL04932
2026-03-28 05:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fc9b844-606d-52ac-9544-55537c0a8c32 with identifier: KL04932 to the API
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:18:12Z',
 'fuel_type': 'diesel',
 'id': '4fc9b844-606d-52ac-9544-55537c0a8c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL04932',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 200971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Track & Field 4Motion',
 'transmission': 'automatic',
 'trim': 'Track & Field 4Motion',
 'year': 2008}
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL04932%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Saving data for KL04932: {'auction_closing_time': 1774714692.0, 'created_time': 1774550886.446017, 'last_price_update_time': 1774676316.721906}
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL04932') HTTP/1.1" 204 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: ZF28173
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: DX07392
2026-03-28 05:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:38 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: JZ39033
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Scrape type for MA51695: 2
2026-03-28 05:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with identifier: MA51695
2026-03-28 05:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with scrape type 2
2026-03-28 05:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with scrape type 2
2026-03-28 05:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 706f56ec-7936-5a06-a36f-b8a1e7db8ec8, identifier: MA51695
2026-03-28 05:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with identifier: MA51695
2026-03-28 05:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with identifier: MA51695
2026-03-28 05:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with identifier: MA51695 to the API
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:08:12Z',
 'fuel_type': 'petrol',
 'id': '706f56ec-7936-5a06-a36f-b8a1e7db8ec8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA51695',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 13401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-12',
 'seller_name': None,
 'title': 'MINI Countryman Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2023}
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Saving data for MA51695: {'auction_closing_time': 1774714092.0, 'created_time': 1774552655.806883, 'last_price_update_time': 1774676318.47404}
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA51695') HTTP/1.1" 204 0
2026-03-28 05:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: VS55791
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS55791%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Scrape type for VS55791: 0
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: TC16779
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: PL22285
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: SW58559
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW58559%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Scrape type for SW58559: 0
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: AD50252
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50252%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Scrape type for AD50252: 2
2026-03-28 05:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9060bfc3-de7d-5beb-b31a-8b3f588b376c with identifier: AD50252
2026-03-28 05:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9060bfc3-de7d-5beb-b31a-8b3f588b376c with scrape type 2
2026-03-28 05:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9060bfc3-de7d-5beb-b31a-8b3f588b376c with scrape type 2
2026-03-28 05:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9060bfc3-de7d-5beb-b31a-8b3f588b376c, identifier: AD50252
2026-03-28 05:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9060bfc3-de7d-5beb-b31a-8b3f588b376c with identifier: AD50252
2026-03-28 05:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9060bfc3-de7d-5beb-b31a-8b3f588b376c with identifier: AD50252
2026-03-28 05:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9060bfc3-de7d-5beb-b31a-8b3f588b376c with identifier: AD50252 to the API
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:27:07Z',
 'fuel_type': 'petrol',
 'id': '9060bfc3-de7d-5beb-b31a-8b3f588b376c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD50252',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 166550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-06',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Trend blue',
 'transmission': 'manual',
 'trim': 'Trend blue',
 'year': 2016}
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50252%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Saving data for AD50252: {'auction_closing_time': 1774715227.0, 'created_time': 1774550603.877016, 'last_price_update_time': 1774676318.953209}
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD50252') HTTP/1.1" 204 0
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: ZC99377
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: LY07442
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY07442%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Scrape type for LY07442: 0
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: ZH98765
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: UJ86189
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: KX31285
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX31285%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Scrape type for KX31285: 0
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: TM05155
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: GD63015
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD63015%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Scrape type for GD63015: 0
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Scrape type for GK14526: 2
2026-03-28 05:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526
2026-03-28 05:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86b4209c-70c6-54ea-a56c-594112fb4f69 with scrape type 2
2026-03-28 05:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86b4209c-70c6-54ea-a56c-594112fb4f69 with scrape type 2
2026-03-28 05:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86b4209c-70c6-54ea-a56c-594112fb4f69, identifier: GK14526
2026-03-28 05:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526
2026-03-28 05:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526
2026-03-28 05:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526 to the API
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:50Z',
 'fuel_type': 'diesel',
 'id': '86b4209c-70c6-54ea-a56c-594112fb4f69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK14526',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 212247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-09',
 'seller_name': None,
 'title': 'Honda CR-V 2.2 DTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2010}
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Saving data for GK14526: {'auction_closing_time': 1774715750.0, 'created_time': 1774552979.639552, 'last_price_update_time': 1774676319.535187}
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK14526') HTTP/1.1" 204 0
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: PD23584
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD23584%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Scrape type for PD23584: 2
2026-03-28 05:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1b5f262-d14c-5db5-aca6-38a40a67c2aa with identifier: PD23584
2026-03-28 05:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1b5f262-d14c-5db5-aca6-38a40a67c2aa with scrape type 2
2026-03-28 05:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1b5f262-d14c-5db5-aca6-38a40a67c2aa with scrape type 2
2026-03-28 05:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1b5f262-d14c-5db5-aca6-38a40a67c2aa, identifier: PD23584
2026-03-28 05:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1b5f262-d14c-5db5-aca6-38a40a67c2aa with identifier: PD23584
2026-03-28 05:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1b5f262-d14c-5db5-aca6-38a40a67c2aa with identifier: PD23584
2026-03-28 05:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1b5f262-d14c-5db5-aca6-38a40a67c2aa with identifier: PD23584 to the API
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:45:11Z',
 'fuel_type': 'petrol',
 'id': 'b1b5f262-d14c-5db5-aca6-38a40a67c2aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD23584',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 264639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-23',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Active Plus Edition',
 'transmission': 'manual',
 'trim': 'Active Plus Edition',
 'year': 2010}
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD23584%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Saving data for PD23584: {'auction_closing_time': 1774716311.0, 'created_time': 1772546180.796855, 'last_price_update_time': 1774676320.097504}
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD23584') HTTP/1.1" 204 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: SN07258
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: PE56791
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for UE11202: 2
2026-03-28 05:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202
2026-03-28 05:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with scrape type 2
2026-03-28 05:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with scrape type 2
2026-03-28 05:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722, identifier: UE11202
2026-03-28 05:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202
2026-03-28 05:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202
2026-03-28 05:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202 to the API
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:28:22Z',
 'fuel_type': 'hybrid',
 'id': '6839f4b5-8145-5ebb-a1d2-b226fb3f6722',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE11202',
 'listing': 'auction',
 'make': 'MG',
 'model': '3',
 'odometer': 11400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-05-15',
 'seller_name': None,
 'title': 'MG 3 1.5 Hybrid+ Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2025}
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Saving data for UE11202: {'auction_closing_time': 1774715302.0, 'created_time': 1774552619.917788, 'last_price_update_time': 1774676320.541563}
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE11202') HTTP/1.1" 204 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for NB64458: 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for SK08799: 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: BU73961
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU73961%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for BU73961: 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP78953%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for WP78953: 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: FP09616
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP09616%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for FP09616: 2
2026-03-28 05:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8954509e-b62f-580f-be33-4a3adfa5ecfa with identifier: FP09616
2026-03-28 05:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8954509e-b62f-580f-be33-4a3adfa5ecfa with scrape type 2
2026-03-28 05:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8954509e-b62f-580f-be33-4a3adfa5ecfa with scrape type 2
2026-03-28 05:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8954509e-b62f-580f-be33-4a3adfa5ecfa, identifier: FP09616
2026-03-28 05:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8954509e-b62f-580f-be33-4a3adfa5ecfa with identifier: FP09616
2026-03-28 05:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8954509e-b62f-580f-be33-4a3adfa5ecfa with identifier: FP09616
2026-03-28 05:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8954509e-b62f-580f-be33-4a3adfa5ecfa with identifier: FP09616 to the API
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 625,
 'expiration_date': '2026-03-28T16:08:41Z',
 'fuel_type': 'petrol',
 'id': '8954509e-b62f-580f-be33-4a3adfa5ecfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP09616',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 126422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-02',
 'seller_name': None,
 'title': 'BMW 5er M5 Competition',
 'transmission': 'automatic',
 'trim': 'Competition',
 'year': 2018}
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP09616%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Saving data for FP09616: {'auction_closing_time': 1774714121.0, 'created_time': 1773229820.346222, 'last_price_update_time': 1774676321.071952}
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP09616') HTTP/1.1" 204 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: JA70507
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA70507%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for JA70507: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: UJ61618
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: CZ79831
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: EG42583
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG42583%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for EG42583: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: SA11397
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for FL94183: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: UY48646
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA01516%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for ZA01516: 0
2026-03-28 05:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:49 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: SC28168
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC28168%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for SC28168: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: JZ87403
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: LR63660
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR63660%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for LR63660: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: MV80796
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV80796%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for MV80796: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: FV55966
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: SY31526
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: ZJ94268
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ94268%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for ZJ94268: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: PZ85127
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ85127%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for PZ85127: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: MF84483
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for CF68220: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: FV82403
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV82403%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for FV82403: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: GF09833
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: JN43536
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: CR26660
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26660%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for CR26660: 2
2026-03-28 05:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a911f53-4293-57e1-af13-34c9a9b4f4ad with identifier: CR26660
2026-03-28 05:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a911f53-4293-57e1-af13-34c9a9b4f4ad with scrape type 2
2026-03-28 05:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a911f53-4293-57e1-af13-34c9a9b4f4ad with scrape type 2
2026-03-28 05:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a911f53-4293-57e1-af13-34c9a9b4f4ad, identifier: CR26660
2026-03-28 05:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a911f53-4293-57e1-af13-34c9a9b4f4ad with identifier: CR26660
2026-03-28 05:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a911f53-4293-57e1-af13-34c9a9b4f4ad with identifier: CR26660
2026-03-28 05:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a911f53-4293-57e1-af13-34c9a9b4f4ad with identifier: CR26660 to the API
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:41:27Z',
 'fuel_type': 'petrol',
 'id': '3a911f53-4293-57e1-af13-34c9a9b4f4ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR26660',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 120278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-19',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2018}
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26660%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Saving data for CR26660: {'auction_closing_time': 1774716087.0, 'created_time': 1774463710.836487, 'last_price_update_time': 1774676329.66043}
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR26660') HTTP/1.1" 204 0
2026-03-28 05:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: WK72065
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: HX62286
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX62286%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for HX62286: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48176%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for TJ48176: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: MF28588
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: MR37320
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for XH00472: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: AD85372
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD85372%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for AD85372: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: JS52679
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS52679%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for JS52679: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: UX22346
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX22346%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for UX22346: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: PL74690
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: TA17370
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA17370%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for TA17370: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: GD45566
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: WA28068
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA28068%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for WA28068: 2
2026-03-28 05:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df1fda5c-abb6-5e47-ad0d-89d94c7ddb31 with identifier: WA28068
2026-03-28 05:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df1fda5c-abb6-5e47-ad0d-89d94c7ddb31 with scrape type 2
2026-03-28 05:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df1fda5c-abb6-5e47-ad0d-89d94c7ddb31 with scrape type 2
2026-03-28 05:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df1fda5c-abb6-5e47-ad0d-89d94c7ddb31, identifier: WA28068
2026-03-28 05:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df1fda5c-abb6-5e47-ad0d-89d94c7ddb31 with identifier: WA28068
2026-03-28 05:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df1fda5c-abb6-5e47-ad0d-89d94c7ddb31 with identifier: WA28068
2026-03-28 05:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df1fda5c-abb6-5e47-ad0d-89d94c7ddb31 with identifier: WA28068 to the API
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:14:02Z',
 'fuel_type': 'petrol',
 'id': 'df1fda5c-abb6-5e47-ad0d-89d94c7ddb31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA28068',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 50359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-01',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Attract 2WD',
 'transmission': 'manual',
 'trim': 'Attract 2WD',
 'year': 2017}
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA28068%27 HTTP/1.1" 200 None
2026-03-28 05:38:50 [auto1.de] INFO: Saving data for WA28068: {'auction_closing_time': 1774714442.0, 'created_time': 1773307032.414712, 'last_price_update_time': 1774676330.319388}
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA28068') HTTP/1.1" 204 0
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: WJ71939
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ71939%27 HTTP/1.1" 200 None
2026-03-28 05:38:50 [auto1.de] INFO: Scrape type for WJ71939: 0
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: UK33964
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK33964%27 HTTP/1.1" 200 None
2026-03-28 05:38:50 [auto1.de] INFO: Scrape type for UK33964: 0
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-28 05:38:50 [auto1.de] INFO: Scrape type for JP57699: 0
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: AN22906
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: ZY13733
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: YM61958
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM61958%27 HTTP/1.1" 200 None
2026-03-28 05:38:50 [auto1.de] INFO: Scrape type for YM61958: 0
2026-03-28 05:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:51 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: DX36556
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX36556%27 HTTP/1.1" 200 None
2026-03-28 05:38:51 [auto1.de] INFO: Scrape type for DX36556: 0
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: RB12464
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: BX80092
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: AP30788
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-28 05:38:51 [auto1.de] INFO: Scrape type for WF46634: 0
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: CV85999
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV85999%27 HTTP/1.1" 200 None
2026-03-28 05:38:51 [auto1.de] INFO: Scrape type for CV85999: 0
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: KN60852
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: VB96858
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: UH63993
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-28 05:38:51 [auto1.de] INFO: Scrape type for LF01905: 2
2026-03-28 05:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcfe3c40-609e-5262-9fb5-17c812e76e39 with identifier: LF01905
2026-03-28 05:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcfe3c40-609e-5262-9fb5-17c812e76e39 with scrape type 2
2026-03-28 05:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcfe3c40-609e-5262-9fb5-17c812e76e39 with scrape type 2
2026-03-28 05:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcfe3c40-609e-5262-9fb5-17c812e76e39, identifier: LF01905
2026-03-28 05:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcfe3c40-609e-5262-9fb5-17c812e76e39 with identifier: LF01905
2026-03-28 05:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcfe3c40-609e-5262-9fb5-17c812e76e39 with identifier: LF01905
2026-03-28 05:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcfe3c40-609e-5262-9fb5-17c812e76e39 with identifier: LF01905 to the API
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:08:32Z',
 'fuel_type': 'petrol',
 'id': 'bcfe3c40-609e-5262-9fb5-17c812e76e39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF01905',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 114748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-26',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2009}
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Saving data for LF01905: {'auction_closing_time': 1774714112.0, 'created_time': 1774550668.677025, 'last_price_update_time': 1774676332.081133}
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF01905') HTTP/1.1" 204 0
2026-03-28 05:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for WM09546: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: XY85080
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA63751%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for PA63751: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: SZ20941
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ20941%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for SZ20941: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for VH67229: 2
2026-03-28 05:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with identifier: VH67229
2026-03-28 05:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with scrape type 2
2026-03-28 05:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with scrape type 2
2026-03-28 05:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f, identifier: VH67229
2026-03-28 05:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with identifier: VH67229
2026-03-28 05:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with identifier: VH67229
2026-03-28 05:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with identifier: VH67229 to the API
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:09:18Z',
 'fuel_type': 'diesel',
 'id': 'd25aeb51-4fde-5bfa-9c9d-88b68a6ba61f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH67229',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 222043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-06',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Saving data for VH67229: {'auction_closing_time': 1774714158.0, 'created_time': 1774552436.979431, 'last_price_update_time': 1774676332.665251}
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH67229') HTTP/1.1" 204 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: AW32080
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: FT09783
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT09783%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for FT09783: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC78210%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for HC78210: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: WB92909
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB92909%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for WB92909: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: FH63073
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH63073%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for FH63073: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for DH60406: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for TK34912: 2
2026-03-28 05:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912
2026-03-28 05:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d178899-534f-531c-863c-87e000d95e7f with scrape type 2
2026-03-28 05:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d178899-534f-531c-863c-87e000d95e7f with scrape type 2
2026-03-28 05:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d178899-534f-531c-863c-87e000d95e7f, identifier: TK34912
2026-03-28 05:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912
2026-03-28 05:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912
2026-03-28 05:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912 to the API
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:31:10Z',
 'fuel_type': 'diesel',
 'id': '4d178899-534f-531c-863c-87e000d95e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK34912',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 118200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-20',
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Kasten Trend',
 'transmission': 'manual',
 'trim': 'Kasten Trend',
 'year': 2016}
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Saving data for TK34912: {'auction_closing_time': 1774715470.0, 'created_time': 1774552929.629483, 'last_price_update_time': 1774676333.184512}
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK34912') HTTP/1.1" 204 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: RY11817
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY11817%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for RY11817: 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for VS20151: 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: MA95783
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA95783%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for MA95783: 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: KZ31354
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: EW67341
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67341%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for EW67341: 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: AC08857
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC08857%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for AC08857: 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: KR13539
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: WJ75594
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: TY90085
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY90085%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for TY90085: 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: AJ01843
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ01843%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for AJ01843: 0
2026-03-28 05:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:54 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: PY95410
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: RT92200
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: XF50561
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for LT54057: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: HU45094
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU45094%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for HU45094: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: PR75210
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR75210%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for PR75210: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: UP37190
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP37190%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for UP37190: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: YR65508
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR65508%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for YR65508: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: RT09280
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09280%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for RT09280: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: BM72646
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: JW05714
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05714%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for JW05714: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: BS29922
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS29922%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for BS29922: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: JE98088
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE98088%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for JE98088: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: UC69607
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-28 05:38:55 [auto1.de] INFO: Scrape type for JR87294: 0
2026-03-28 05:38:55 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-28 05:38:55 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-28 05:38:55 [auto1.de] INFO: Found listing with ID: BC71264
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC71264%27 HTTP/1.1" 200 None
2026-03-28 05:38:55 [auto1.de] INFO: Scrape type for BC71264: 2
2026-03-28 05:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ad1b19d-e10c-577e-8211-5ea44b47376f with identifier: BC71264
2026-03-28 05:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ad1b19d-e10c-577e-8211-5ea44b47376f with scrape type 2
2026-03-28 05:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ad1b19d-e10c-577e-8211-5ea44b47376f with scrape type 2
2026-03-28 05:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ad1b19d-e10c-577e-8211-5ea44b47376f, identifier: BC71264
2026-03-28 05:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ad1b19d-e10c-577e-8211-5ea44b47376f with identifier: BC71264
2026-03-28 05:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ad1b19d-e10c-577e-8211-5ea44b47376f with identifier: BC71264
2026-03-28 05:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ad1b19d-e10c-577e-8211-5ea44b47376f with identifier: BC71264 to the API
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:49:13Z',
 'fuel_type': 'diesel',
 'id': '1ad1b19d-e10c-577e-8211-5ea44b47376f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC71264',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 182564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-22',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 d 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic BlueTEC Avantgarde',
 'year': 2014}
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC71264%27 HTTP/1.1" 200 None
2026-03-28 05:38:55 [auto1.de] INFO: Saving data for BC71264: {'auction_closing_time': 1774716553.0, 'created_time': 1774464265.492884, 'last_price_update_time': 1774676335.439621}
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC71264') HTTP/1.1" 204 0
2026-03-28 05:38:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:55 [auto1.de] INFO: Found listing with ID: DB54386
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB54386%27 HTTP/1.1" 200 None
2026-03-28 05:38:55 [auto1.de] INFO: Scrape type for DB54386: 2
2026-03-28 05:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f4fe1f-9b37-5877-b121-fbf300804979 with identifier: DB54386
2026-03-28 05:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f4fe1f-9b37-5877-b121-fbf300804979 with scrape type 2
2026-03-28 05:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f4fe1f-9b37-5877-b121-fbf300804979 with scrape type 2
2026-03-28 05:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34f4fe1f-9b37-5877-b121-fbf300804979, identifier: DB54386
2026-03-28 05:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34f4fe1f-9b37-5877-b121-fbf300804979 with identifier: DB54386
2026-03-28 05:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34f4fe1f-9b37-5877-b121-fbf300804979 with identifier: DB54386
2026-03-28 05:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34f4fe1f-9b37-5877-b121-fbf300804979 with identifier: DB54386 to the API
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:00:23Z',
 'fuel_type': 'petrol',
 'id': '34f4fe1f-9b37-5877-b121-fbf300804979',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB54386',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 53380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-12',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2015}
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB54386%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Saving data for DB54386: {'auction_closing_time': 1774713623.0, 'created_time': 1774465821.675289, 'last_price_update_time': 1774676336.078448}
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB54386') HTTP/1.1" 204 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: DE70516
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE70516%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for DE70516: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: AN12831
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: EL83398
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL83398%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for EL83398: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: XE96364
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: FG57535
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: GN29704
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: WH80890
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: ZW43695
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: TK89986
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89986%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for TK89986: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for EH98635: 2
2026-03-28 05:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635
2026-03-28 05:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a653b3-bfc7-5242-b232-61b7f69943ee with scrape type 2
2026-03-28 05:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a653b3-bfc7-5242-b232-61b7f69943ee with scrape type 2
2026-03-28 05:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7a653b3-bfc7-5242-b232-61b7f69943ee, identifier: EH98635
2026-03-28 05:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635
2026-03-28 05:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635
2026-03-28 05:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635 to the API
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:37:17Z',
 'fuel_type': 'diesel',
 'id': 'b7a653b3-bfc7-5242-b232-61b7f69943ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH98635',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 247631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-21',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2011}
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Saving data for EH98635: {'auction_closing_time': 1774715837.0, 'created_time': 1774552675.16393, 'last_price_update_time': 1774676336.568262}
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH98635') HTTP/1.1" 204 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: DY62455
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: CS42122
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS42122%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for CS42122: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: VU26038
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU26038%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for VU26038: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-28 05:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:57 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: FZ97744
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ97744%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for FZ97744: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY24056%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for KY24056: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: FU42762
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for GK88230: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX65869%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for NX65869: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: NV55491
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: YF52750
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: HX03519
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: UZ16181
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ16181%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for UZ16181: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: MS62719
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for TW80485: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: SR67538
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR67538%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for SR67538: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: JR27484
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: EX94695
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: PN20097
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: UA31862
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA31862%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for UA31862: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: FP87912
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP87912%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for FP87912: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: JF93037
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF93037%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for JF93037: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for VJ44121: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: LY36770
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: KS41685
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: ZZ69098
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ69098%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for ZZ69098: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: DR00758
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR00758%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for DR00758: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: XK53444
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: ZK88504
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK88504%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for ZK88504: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: UB87978
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: DU95569
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU95569%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for DU95569: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: WC00237
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: JE86051
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE86051%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for JE86051: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: YL83790
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL83790%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for YL83790: 2
2026-03-28 05:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58e14a55-6346-5ff8-9f47-4c65d0435820 with identifier: YL83790
2026-03-28 05:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e14a55-6346-5ff8-9f47-4c65d0435820 with scrape type 2
2026-03-28 05:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58e14a55-6346-5ff8-9f47-4c65d0435820 with scrape type 2
2026-03-28 05:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58e14a55-6346-5ff8-9f47-4c65d0435820, identifier: YL83790
2026-03-28 05:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58e14a55-6346-5ff8-9f47-4c65d0435820 with identifier: YL83790
2026-03-28 05:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58e14a55-6346-5ff8-9f47-4c65d0435820 with identifier: YL83790
2026-03-28 05:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58e14a55-6346-5ff8-9f47-4c65d0435820 with identifier: YL83790 to the API
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:55:21Z',
 'fuel_type': 'petrol',
 'id': '58e14a55-6346-5ff8-9f47-4c65d0435820',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL83790',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 95204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-21',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL83790%27 HTTP/1.1" 200 None
2026-03-28 05:38:58 [auto1.de] INFO: Saving data for YL83790: {'auction_closing_time': 1774716921.0, 'created_time': 1774463654.095403, 'last_price_update_time': 1774676338.365956}
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL83790') HTTP/1.1" 204 0
2026-03-28 05:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: TA53494
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA53494%27 HTTP/1.1" 200 None
2026-03-28 05:38:58 [auto1.de] INFO: Scrape type for TA53494: 2
2026-03-28 05:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a9ebf8e-cd9e-530c-9870-36137ea849dc with identifier: TA53494
2026-03-28 05:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a9ebf8e-cd9e-530c-9870-36137ea849dc with scrape type 2
2026-03-28 05:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a9ebf8e-cd9e-530c-9870-36137ea849dc with scrape type 2
2026-03-28 05:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a9ebf8e-cd9e-530c-9870-36137ea849dc, identifier: TA53494
2026-03-28 05:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a9ebf8e-cd9e-530c-9870-36137ea849dc with identifier: TA53494
2026-03-28 05:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a9ebf8e-cd9e-530c-9870-36137ea849dc with identifier: TA53494
2026-03-28 05:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a9ebf8e-cd9e-530c-9870-36137ea849dc with identifier: TA53494 to the API
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:27Z',
 'fuel_type': 'diesel',
 'id': '7a9ebf8e-cd9e-530c-9870-36137ea849dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA53494',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 199857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-14',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA53494%27 HTTP/1.1" 200 None
2026-03-28 05:38:58 [auto1.de] INFO: Saving data for TA53494: {'auction_closing_time': 1774715067.0, 'created_time': 1774467456.449358, 'last_price_update_time': 1774676338.873905}
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA53494') HTTP/1.1" 204 0
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: NP13175
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP13175%27 HTTP/1.1" 200 None
2026-03-28 05:38:58 [auto1.de] INFO: Scrape type for NP13175: 2
2026-03-28 05:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40694a2f-fb6b-5d06-a306-6fd830db4f75 with identifier: NP13175
2026-03-28 05:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40694a2f-fb6b-5d06-a306-6fd830db4f75 with scrape type 2
2026-03-28 05:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40694a2f-fb6b-5d06-a306-6fd830db4f75 with scrape type 2
2026-03-28 05:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40694a2f-fb6b-5d06-a306-6fd830db4f75, identifier: NP13175
2026-03-28 05:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40694a2f-fb6b-5d06-a306-6fd830db4f75 with identifier: NP13175
2026-03-28 05:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40694a2f-fb6b-5d06-a306-6fd830db4f75 with identifier: NP13175
2026-03-28 05:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40694a2f-fb6b-5d06-a306-6fd830db4f75 with identifier: NP13175 to the API
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:15:13Z',
 'fuel_type': 'diesel',
 'id': '40694a2f-fb6b-5d06-a306-6fd830db4f75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP13175',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 273919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-01',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP13175%27 HTTP/1.1" 200 None
2026-03-28 05:38:59 [auto1.de] INFO: Saving data for NP13175: {'auction_closing_time': 1774714513.0, 'created_time': 1774464118.307315, 'last_price_update_time': 1774676339.325087}
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP13175') HTTP/1.1" 204 0
2026-03-28 05:38:59 [auto1.de] INFO: Found listing with ID: KS63717
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS63717%27 HTTP/1.1" 200 None
2026-03-28 05:38:59 [auto1.de] INFO: Scrape type for KS63717: 0
2026-03-28 05:38:59 [auto1.de] INFO: Found listing with ID: FT98608
2026-03-28 05:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:00 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: GA14949
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA14949%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Scrape type for GA14949: 0
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: JG20363
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG20363%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Scrape type for JG20363: 0
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: KD43899
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD43899%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Scrape type for KD43899: 0
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: NU10771
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: XL21584
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL21584%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Scrape type for XL21584: 0
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: DX08468
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: XK58974
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: BV38290
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: DP39358
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: TJ48727
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48727%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Scrape type for TJ48727: 0
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: US71241
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Scrape type for US71241: 2
2026-03-28 05:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241
2026-03-28 05:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with scrape type 2
2026-03-28 05:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with scrape type 2
2026-03-28 05:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd, identifier: US71241
2026-03-28 05:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241
2026-03-28 05:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241
2026-03-28 05:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241 to the API
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:33:53Z',
 'fuel_type': 'petrol',
 'id': '10f50ef8-9aba-5924-bcc2-b05fb5cf08dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US71241',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 182817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-29',
 'seller_name': None,
 'title': 'Fiat Doblo 1.4 Turbo Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2013}
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Saving data for US71241: {'auction_closing_time': 1774715633.0, 'created_time': 1774552152.038279, 'last_price_update_time': 1774676340.884377}
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US71241') HTTP/1.1" 204 0
2026-03-28 05:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: RT49576
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52961%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for TJ52961: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF10018%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for XF10018: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: LH00123
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH00123%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for LH00123: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: GX30612
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: WV66360
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: DK15420
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK15420%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for DK15420: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for FV50908: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: HP20518
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: WW30672
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW30672%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for WW30672: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: BM70881
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM70881%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for BM70881: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: VH10251
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10251%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for VH10251: 2
2026-03-28 05:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 950bccdc-0bbb-5566-ba84-b1a4cecc4ccf with identifier: VH10251
2026-03-28 05:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950bccdc-0bbb-5566-ba84-b1a4cecc4ccf with scrape type 2
2026-03-28 05:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 950bccdc-0bbb-5566-ba84-b1a4cecc4ccf with scrape type 2
2026-03-28 05:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 950bccdc-0bbb-5566-ba84-b1a4cecc4ccf, identifier: VH10251
2026-03-28 05:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 950bccdc-0bbb-5566-ba84-b1a4cecc4ccf with identifier: VH10251
2026-03-28 05:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 950bccdc-0bbb-5566-ba84-b1a4cecc4ccf with identifier: VH10251
2026-03-28 05:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 950bccdc-0bbb-5566-ba84-b1a4cecc4ccf with identifier: VH10251 to the API
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:38Z',
 'fuel_type': 'diesel',
 'id': '950bccdc-0bbb-5566-ba84-b1a4cecc4ccf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH10251',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 192224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-24',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10251%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Saving data for VH10251: {'auction_closing_time': 1774715378.0, 'created_time': 1774466749.04169, 'last_price_update_time': 1774676341.530428}
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH10251') HTTP/1.1" 204 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: YV13376
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: NR78945
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: NC53020
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC53020%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for NC53020: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: TF56080
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: CB60323
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB60323%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for CB60323: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for YN95759: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: CL04690
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: FY34771
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY34771%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for FY34771: 2
2026-03-28 05:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69b31b1-5e3b-5499-ba53-1ea5ed184b20 with identifier: FY34771
2026-03-28 05:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69b31b1-5e3b-5499-ba53-1ea5ed184b20 with scrape type 2
2026-03-28 05:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b69b31b1-5e3b-5499-ba53-1ea5ed184b20 with scrape type 2
2026-03-28 05:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b69b31b1-5e3b-5499-ba53-1ea5ed184b20, identifier: FY34771
2026-03-28 05:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b69b31b1-5e3b-5499-ba53-1ea5ed184b20 with identifier: FY34771
2026-03-28 05:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b69b31b1-5e3b-5499-ba53-1ea5ed184b20 with identifier: FY34771
2026-03-28 05:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b69b31b1-5e3b-5499-ba53-1ea5ed184b20 with identifier: FY34771 to the API
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:52:39Z',
 'fuel_type': 'petrol',
 'id': 'b69b31b1-5e3b-5499-ba53-1ea5ed184b20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY34771',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 61369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-24',
 'seller_name': None,
 'title': 'Audi A4 40 TFSI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY34771%27 HTTP/1.1" 200 None
2026-03-28 05:39:02 [auto1.de] INFO: Saving data for FY34771: {'auction_closing_time': 1774716759.0, 'created_time': 1774466373.010451, 'last_price_update_time': 1774676342.160829}
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY34771') HTTP/1.1" 204 0
2026-03-28 05:39:02 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-28 05:39:02 [auto1.de] INFO: Found listing with ID: AW34840
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW34840%27 HTTP/1.1" 200 None
2026-03-28 05:39:02 [auto1.de] INFO: Scrape type for AW34840: 0
2026-03-28 05:39:02 [auto1.de] INFO: Found listing with ID: AP83246
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP83246%27 HTTP/1.1" 200 None
2026-03-28 05:39:02 [auto1.de] INFO: Scrape type for AP83246: 2
2026-03-28 05:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 683eb1be-4108-568b-b425-25f4dcced083 with identifier: AP83246
2026-03-28 05:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 683eb1be-4108-568b-b425-25f4dcced083 with scrape type 2
2026-03-28 05:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 683eb1be-4108-568b-b425-25f4dcced083 with scrape type 2
2026-03-28 05:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 683eb1be-4108-568b-b425-25f4dcced083, identifier: AP83246
2026-03-28 05:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 683eb1be-4108-568b-b425-25f4dcced083 with identifier: AP83246
2026-03-28 05:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 683eb1be-4108-568b-b425-25f4dcced083 with identifier: AP83246
2026-03-28 05:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 683eb1be-4108-568b-b425-25f4dcced083 with identifier: AP83246 to the API
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:02:25Z',
 'fuel_type': 'diesel',
 'id': '683eb1be-4108-568b-b425-25f4dcced083',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP83246',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 99715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-09',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP83246%27 HTTP/1.1" 200 None
2026-03-28 05:39:02 [auto1.de] INFO: Saving data for AP83246: {'auction_closing_time': 1774713745.0, 'created_time': 1774463642.065289, 'last_price_update_time': 1774676342.640987}
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP83246') HTTP/1.1" 204 0
2026-03-28 05:39:02 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-28 05:39:02 [auto1.de] INFO: Scrape type for FP32439: 0
2026-03-28 05:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:03 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: YF37634
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: YZ97143
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ97143%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for YZ97143: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: XE27570
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE27570%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for XE27570: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for KR20197: 2
2026-03-28 05:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197
2026-03-28 05:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with scrape type 2
2026-03-28 05:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with scrape type 2
2026-03-28 05:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38, identifier: KR20197
2026-03-28 05:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197
2026-03-28 05:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197
2026-03-28 05:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197 to the API
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:52:30Z',
 'fuel_type': 'petrol',
 'id': '8ac9c1dc-800d-5013-bff2-8965d9b1bd38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR20197',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 97069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-01',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Saving data for KR20197: {'auction_closing_time': 1774716750.0, 'created_time': 1774553060.659748, 'last_price_update_time': 1774676344.324122}
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR20197') HTTP/1.1" 204 0
2026-03-28 05:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: VZ67143
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: TV42528
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV42528%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for TV42528: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: WV18755
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV18755%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for WV18755: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: FT81619
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT81619%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for FT81619: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: HX10510
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: RA28898
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28898%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for RA28898: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: DN55210
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for AM19734: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: CJ14653
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ14653%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for CJ14653: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: WY54467
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: EF17850
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for GE87881: 2
2026-03-28 05:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881
2026-03-28 05:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d829f77c-2554-5c6d-a935-664f70684e7d with scrape type 2
2026-03-28 05:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d829f77c-2554-5c6d-a935-664f70684e7d with scrape type 2
2026-03-28 05:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d829f77c-2554-5c6d-a935-664f70684e7d, identifier: GE87881
2026-03-28 05:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881
2026-03-28 05:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881
2026-03-28 05:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881 to the API
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:11:28Z',
 'fuel_type': 'diesel',
 'id': 'd829f77c-2554-5c6d-a935-664f70684e7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE87881',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 96990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-21',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 1.9 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2008}
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Saving data for GE87881: {'auction_closing_time': 1774714288.0, 'created_time': 1774552899.19547, 'last_price_update_time': 1774676344.862764}
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE87881') HTTP/1.1" 204 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: YK91002
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: EG62319
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for PF20752: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: NZ55073
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ55073%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for NZ55073: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: GU28409
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28409%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for GU28409: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: UU71497
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: ZX84028
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84028%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for ZX84028: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: DH94169
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH94169%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for DH94169: 2
2026-03-28 05:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90ff884f-6475-5e4d-be9e-c9483bc48eaf with identifier: DH94169
2026-03-28 05:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90ff884f-6475-5e4d-be9e-c9483bc48eaf with scrape type 2
2026-03-28 05:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90ff884f-6475-5e4d-be9e-c9483bc48eaf with scrape type 2
2026-03-28 05:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90ff884f-6475-5e4d-be9e-c9483bc48eaf, identifier: DH94169
2026-03-28 05:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90ff884f-6475-5e4d-be9e-c9483bc48eaf with identifier: DH94169
2026-03-28 05:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90ff884f-6475-5e4d-be9e-c9483bc48eaf with identifier: DH94169
2026-03-28 05:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90ff884f-6475-5e4d-be9e-c9483bc48eaf with identifier: DH94169 to the API
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 52,
 'expiration_date': '2026-03-28T16:45:00Z',
 'fuel_type': 'petrol',
 'id': '90ff884f-6475-5e4d-be9e-c9483bc48eaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH94169',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Matiz',
 'odometer': 90069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-10',
 'seller_name': None,
 'title': 'Chevrolet Matiz 0.8 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2009}
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH94169%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Saving data for DH94169: {'auction_closing_time': 1774716300.0, 'created_time': 1774467409.083668, 'last_price_update_time': 1774676345.507208}
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH94169') HTTP/1.1" 204 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: KF03787
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: SB57558
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB57558%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for SB57558: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: HB59808
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: GP04602
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP04602%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for GP04602: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: DR78688
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR78688%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for DR78688: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: ML80867
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: BY66745
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY66745%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for BY66745: 2
2026-03-28 05:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7805cf1-a39e-519b-a365-2373cbb49e8c with identifier: BY66745
2026-03-28 05:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7805cf1-a39e-519b-a365-2373cbb49e8c with scrape type 2
2026-03-28 05:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7805cf1-a39e-519b-a365-2373cbb49e8c with scrape type 2
2026-03-28 05:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7805cf1-a39e-519b-a365-2373cbb49e8c, identifier: BY66745
2026-03-28 05:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7805cf1-a39e-519b-a365-2373cbb49e8c with identifier: BY66745
2026-03-28 05:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7805cf1-a39e-519b-a365-2373cbb49e8c with identifier: BY66745
2026-03-28 05:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7805cf1-a39e-519b-a365-2373cbb49e8c with identifier: BY66745 to the API
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:43:24Z',
 'fuel_type': 'diesel',
 'id': 'c7805cf1-a39e-519b-a365-2373cbb49e8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY66745',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 63290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-24',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY66745%27 HTTP/1.1" 200 None
2026-03-28 05:39:06 [auto1.de] INFO: Saving data for BY66745: {'auction_closing_time': 1774716204.0, 'created_time': 1774468168.155102, 'last_price_update_time': 1774676346.004672}
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY66745') HTTP/1.1" 204 0
2026-03-28 05:39:06 [auto1.de] INFO: Found listing with ID: ZD20982
2026-03-28 05:39:06 [auto1.de] INFO: Found listing with ID: GP35635
2026-03-28 05:39:06 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-28 05:39:06 [auto1.de] INFO: Scrape type for SC87676: 0
2026-03-28 05:39:06 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY42515%27 HTTP/1.1" 200 None
2026-03-28 05:39:06 [auto1.de] INFO: Scrape type for RY42515: 0
2026-03-28 05:39:06 [scrapy.extensions.logstats] INFO: Crawled 161 pages (at 16 pages/min), scraped 611 items (at 65 items/min)
2026-03-28 05:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:06 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:06 [auto1.de] INFO: Found listing with ID: VE74198
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE74198%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for VE74198: 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: VD76950
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: RF82570
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF82570%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for RF82570: 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for UA95146: 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: CT48596
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT48596%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for CT48596: 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: XC02401
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC02401%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for XC02401: 2
2026-03-28 05:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a3fcc97-8497-5e4b-a650-c0f9a68a6562 with identifier: XC02401
2026-03-28 05:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a3fcc97-8497-5e4b-a650-c0f9a68a6562 with scrape type 2
2026-03-28 05:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a3fcc97-8497-5e4b-a650-c0f9a68a6562 with scrape type 2
2026-03-28 05:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a3fcc97-8497-5e4b-a650-c0f9a68a6562, identifier: XC02401
2026-03-28 05:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a3fcc97-8497-5e4b-a650-c0f9a68a6562 with identifier: XC02401
2026-03-28 05:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a3fcc97-8497-5e4b-a650-c0f9a68a6562 with identifier: XC02401
2026-03-28 05:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a3fcc97-8497-5e4b-a650-c0f9a68a6562 with identifier: XC02401 to the API
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:36:38Z',
 'fuel_type': 'petrol',
 'id': '6a3fcc97-8497-5e4b-a650-c0f9a68a6562',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC02401',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 51138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC02401%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Saving data for XC02401: {'auction_closing_time': 1774715798.0, 'created_time': 1774464466.555135, 'last_price_update_time': 1774676347.503396}
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC02401') HTTP/1.1" 204 0
2026-03-28 05:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: PR60744
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: CT34743
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: HN83229
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN83229%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for HN83229: 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for UC60552: 2
2026-03-28 05:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552
2026-03-28 05:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with scrape type 2
2026-03-28 05:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with scrape type 2
2026-03-28 05:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ece0655-13ae-5e38-93cc-8f662eab1ef2, identifier: UC60552
2026-03-28 05:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552
2026-03-28 05:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552
2026-03-28 05:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552 to the API
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:52:17Z',
 'fuel_type': 'petrol',
 'id': '5ece0655-13ae-5e38-93cc-8f662eab1ef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC60552',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 173128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-28',
 'seller_name': None,
 'title': "Kia cee'd 1.6 TGDI GT-Challenge",
 'transmission': 'manual',
 'trim': 'GT-Challenge',
 'year': 2017}
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-28 05:39:08 [auto1.de] INFO: Saving data for UC60552: {'auction_closing_time': 1774716737.0, 'created_time': 1774552542.171765, 'last_price_update_time': 1774676348.061466}
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC60552') HTTP/1.1" 204 0
2026-03-28 05:39:08 [auto1.de] INFO: Found listing with ID: VV12952
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV12952%27 HTTP/1.1" 200 None
2026-03-28 05:39:08 [auto1.de] INFO: Scrape type for VV12952: 2
2026-03-28 05:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d66cac5-8055-557b-91d6-2ee36cb7986b with identifier: VV12952
2026-03-28 05:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d66cac5-8055-557b-91d6-2ee36cb7986b with scrape type 2
2026-03-28 05:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d66cac5-8055-557b-91d6-2ee36cb7986b with scrape type 2
2026-03-28 05:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d66cac5-8055-557b-91d6-2ee36cb7986b, identifier: VV12952
2026-03-28 05:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d66cac5-8055-557b-91d6-2ee36cb7986b with identifier: VV12952
2026-03-28 05:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d66cac5-8055-557b-91d6-2ee36cb7986b with identifier: VV12952
2026-03-28 05:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d66cac5-8055-557b-91d6-2ee36cb7986b with identifier: VV12952 to the API
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:35:08Z',
 'fuel_type': 'petrol',
 'id': '4d66cac5-8055-557b-91d6-2ee36cb7986b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV12952',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 80381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-14',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2015}
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV12952%27 HTTP/1.1" 200 None
2026-03-28 05:39:09 [auto1.de] INFO: Saving data for VV12952: {'auction_closing_time': 1774715708.0, 'created_time': 1774464161.886448, 'last_price_update_time': 1774676349.383147}
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV12952') HTTP/1.1" 204 0
2026-03-28 05:39:09 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-28 05:39:09 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-28 05:39:09 [auto1.de] INFO: Found listing with ID: GU38218
2026-03-28 05:39:09 [auto1.de] INFO: Found listing with ID: KX72487
2026-03-28 05:39:09 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-28 05:39:09 [auto1.de] INFO: Scrape type for SX98211: 2
2026-03-28 05:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03a1f826-522b-5428-8f32-a4be4625dfcd with identifier: SX98211
2026-03-28 05:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03a1f826-522b-5428-8f32-a4be4625dfcd with scrape type 2
2026-03-28 05:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03a1f826-522b-5428-8f32-a4be4625dfcd with scrape type 2
2026-03-28 05:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03a1f826-522b-5428-8f32-a4be4625dfcd, identifier: SX98211
2026-03-28 05:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03a1f826-522b-5428-8f32-a4be4625dfcd with identifier: SX98211
2026-03-28 05:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03a1f826-522b-5428-8f32-a4be4625dfcd with identifier: SX98211
2026-03-28 05:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03a1f826-522b-5428-8f32-a4be4625dfcd with identifier: SX98211 to the API
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:07:15Z',
 'fuel_type': 'petrol',
 'id': '03a1f826-522b-5428-8f32-a4be4625dfcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX98211',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 108228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-24',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2014}
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-28 05:39:09 [auto1.de] INFO: Saving data for SX98211: {'auction_closing_time': 1774714035.0, 'created_time': 1774552440.302758, 'last_price_update_time': 1774676349.82283}
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX98211') HTTP/1.1" 204 0
2026-03-28 05:39:09 [auto1.de] INFO: Found listing with ID: LS15583
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS15583%27 HTTP/1.1" 200 None
2026-03-28 05:39:09 [auto1.de] INFO: Scrape type for LS15583: 0
2026-03-28 05:39:09 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-28 05:39:09 [auto1.de] INFO: Scrape type for KK19800: 2
2026-03-28 05:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800
2026-03-28 05:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc01c29-9127-57a0-b84a-ed1bd9c15828 with scrape type 2
2026-03-28 05:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc01c29-9127-57a0-b84a-ed1bd9c15828 with scrape type 2
2026-03-28 05:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc01c29-9127-57a0-b84a-ed1bd9c15828, identifier: KK19800
2026-03-28 05:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800
2026-03-28 05:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800
2026-03-28 05:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800 to the API
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:08Z',
 'fuel_type': 'diesel',
 'id': 'edc01c29-9127-57a0-b84a-ed1bd9c15828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK19800',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 101989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-16',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Style 4Motion',
 'year': 2018}
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Saving data for KK19800: {'auction_closing_time': 1774716608.0, 'created_time': 1774552600.644766, 'last_price_update_time': 1774676350.367406}
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK19800') HTTP/1.1" 204 0
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: XV84732
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH43382%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Scrape type for UH43382: 0
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: VR43125
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR43125%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Scrape type for VR43125: 0
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Scrape type for DG24182: 2
2026-03-28 05:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182
2026-03-28 05:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 391363dd-df68-5ec1-8671-1bfa10354a9b with scrape type 2
2026-03-28 05:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 391363dd-df68-5ec1-8671-1bfa10354a9b with scrape type 2
2026-03-28 05:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 391363dd-df68-5ec1-8671-1bfa10354a9b, identifier: DG24182
2026-03-28 05:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182
2026-03-28 05:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182
2026-03-28 05:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182 to the API
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:21:16Z',
 'fuel_type': 'petrol',
 'id': '391363dd-df68-5ec1-8671-1bfa10354a9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG24182',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 55281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2021}
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Saving data for DG24182: {'auction_closing_time': 1774714876.0, 'created_time': 1774553000.517741, 'last_price_update_time': 1774676350.872901}
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG24182') HTTP/1.1" 204 0
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: JA20872
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA20872%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Scrape type for JA20872: 0
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: SC92395
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92395%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Scrape type for SC92395: 0
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: HE94758
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: HD83782
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: MS15340
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: SJ07380
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Scrape type for FZ02715: 0
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL47006%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Scrape type for YL47006: 0
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: NH90612
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: VN15291
2026-03-28 05:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:11 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: JH32543
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH32543%27 HTTP/1.1" 200 None
2026-03-28 05:39:11 [auto1.de] INFO: Scrape type for JH32543: 0
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: FX11245
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: NA05551
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA05551%27 HTTP/1.1" 200 None
2026-03-28 05:39:11 [auto1.de] INFO: Scrape type for NA05551: 0
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: VJ91223
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: NP76557
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: KM31933
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM31933%27 HTTP/1.1" 200 None
2026-03-28 05:39:11 [auto1.de] INFO: Scrape type for KM31933: 2
2026-03-28 05:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eb8951f-1e8a-5257-8de8-bdfec2864452 with identifier: KM31933
2026-03-28 05:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb8951f-1e8a-5257-8de8-bdfec2864452 with scrape type 2
2026-03-28 05:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eb8951f-1e8a-5257-8de8-bdfec2864452 with scrape type 2
2026-03-28 05:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2eb8951f-1e8a-5257-8de8-bdfec2864452, identifier: KM31933
2026-03-28 05:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2eb8951f-1e8a-5257-8de8-bdfec2864452 with identifier: KM31933
2026-03-28 05:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2eb8951f-1e8a-5257-8de8-bdfec2864452 with identifier: KM31933
2026-03-28 05:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2eb8951f-1e8a-5257-8de8-bdfec2864452 with identifier: KM31933 to the API
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:40:59Z',
 'fuel_type': 'petrol',
 'id': '2eb8951f-1e8a-5257-8de8-bdfec2864452',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM31933',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 112494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2006}
2026-03-28 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM31933%27 HTTP/1.1" 200 None
2026-03-28 05:39:12 [auto1.de] INFO: Saving data for KM31933: {'auction_closing_time': 1774716059.0, 'created_time': 1774466158.397527, 'last_price_update_time': 1774676352.959426}
2026-03-28 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM31933') HTTP/1.1" 204 0
2026-03-28 05:39:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: BU33854
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: MG02873
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: XA58573
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA58573%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for XA58573: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: JR91951
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: DM83543
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: AL68838
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL68838%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for AL68838: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for BB70854: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: AF55213
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF55213%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for AF55213: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: SL88176
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for NR99017: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: XK43796
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK43796%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for XK43796: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: AM90654
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: XA78750
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78750%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for XA78750: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: DC32066
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32066%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for DC32066: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71547%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for FJ71547: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: LL60236
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60236%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for LL60236: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: CW00084
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: JC86986
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC86986%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for JC86986: 2
2026-03-28 05:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2680ceee-f7aa-55b9-a7d0-11738f3904ac with identifier: JC86986
2026-03-28 05:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2680ceee-f7aa-55b9-a7d0-11738f3904ac with scrape type 2
2026-03-28 05:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2680ceee-f7aa-55b9-a7d0-11738f3904ac with scrape type 2
2026-03-28 05:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2680ceee-f7aa-55b9-a7d0-11738f3904ac, identifier: JC86986
2026-03-28 05:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2680ceee-f7aa-55b9-a7d0-11738f3904ac with identifier: JC86986
2026-03-28 05:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2680ceee-f7aa-55b9-a7d0-11738f3904ac with identifier: JC86986
2026-03-28 05:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2680ceee-f7aa-55b9-a7d0-11738f3904ac with identifier: JC86986 to the API
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:18:20Z',
 'fuel_type': 'petrol',
 'id': '2680ceee-f7aa-55b9-a7d0-11738f3904ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC86986',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 79492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'R BlueMotion 4Motion',
 'year': 2019}
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC86986%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Saving data for JC86986: {'auction_closing_time': 1774714700.0, 'created_time': 1774465669.319412, 'last_price_update_time': 1774676353.640658}
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC86986') HTTP/1.1" 204 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: BB99757
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB99757%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for BB99757: 2
2026-03-28 05:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc30fcf6-9ed5-57a4-9a08-3ac995b5b6e1 with identifier: BB99757
2026-03-28 05:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc30fcf6-9ed5-57a4-9a08-3ac995b5b6e1 with scrape type 2
2026-03-28 05:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc30fcf6-9ed5-57a4-9a08-3ac995b5b6e1 with scrape type 2
2026-03-28 05:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc30fcf6-9ed5-57a4-9a08-3ac995b5b6e1, identifier: BB99757
2026-03-28 05:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc30fcf6-9ed5-57a4-9a08-3ac995b5b6e1 with identifier: BB99757
2026-03-28 05:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc30fcf6-9ed5-57a4-9a08-3ac995b5b6e1 with identifier: BB99757
2026-03-28 05:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc30fcf6-9ed5-57a4-9a08-3ac995b5b6e1 with identifier: BB99757 to the API
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:08:14Z',
 'fuel_type': 'diesel',
 'id': 'dc30fcf6-9ed5-57a4-9a08-3ac995b5b6e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB99757',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 California',
 'odometer': 183072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-13',
 'seller_name': None,
 'title': 'Volkswagen T5 California 2.0 TDI Beach Aufstelldach 4Motion',
 'transmission': 'manual',
 'trim': 'Beach Aufstelldach 4Motion',
 'year': 2014}
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB99757%27 HTTP/1.1" 200 None
2026-03-28 05:39:14 [auto1.de] INFO: Saving data for BB99757: {'auction_closing_time': 1774714094.0, 'created_time': 1774467762.60877, 'last_price_update_time': 1774676354.176139}
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB99757') HTTP/1.1" 204 0
2026-03-28 05:39:14 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-28 05:39:14 [auto1.de] INFO: Found listing with ID: TD86732
2026-03-28 05:39:14 [auto1.de] INFO: Found listing with ID: CY30248
2026-03-28 05:39:14 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-28 05:39:14 [auto1.de] INFO: Found listing with ID: BW18198
2026-03-28 05:39:14 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-28 05:39:14 [auto1.de] INFO: Scrape type for FC58368: 0
2026-03-28 05:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:15 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: TZ47982
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ47982%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for TZ47982: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: RZ82466
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: SJ24740
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: UZ74355
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ74355%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for UZ74355: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: NS26780
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01132%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for KE01132: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for LT29180: 2
2026-03-28 05:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180
2026-03-28 05:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with scrape type 2
2026-03-28 05:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with scrape type 2
2026-03-28 05:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a, identifier: LT29180
2026-03-28 05:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180
2026-03-28 05:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180
2026-03-28 05:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180 to the API
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:42:52Z',
 'fuel_type': 'petrol',
 'id': '40b4d1f6-4b6e-5b78-9f54-c6c8b553980a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT29180',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 263326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-09',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Saving data for LT29180: {'auction_closing_time': 1774716172.0, 'created_time': 1774551841.295708, 'last_price_update_time': 1774676355.753734}
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT29180') HTTP/1.1" 204 0
2026-03-28 05:39:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: LB67403
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: JF05808
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: TK16226
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK16226%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for TK16226: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: TT57890
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT57890%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for TT57890: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: DJ51254
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU83796%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for YU83796: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: MC69974
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: TP89237
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP89237%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for TP89237: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: MN03229
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN03229%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for MN03229: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: LX44936
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44936%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for LX44936: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for AW26108: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-28 05:39:16 [auto1.de] INFO: Scrape type for TY75534: 0
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: GB84856
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB84856%27 HTTP/1.1" 200 None
2026-03-28 05:39:16 [auto1.de] INFO: Scrape type for GB84856: 0
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: SN71189
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: SG03941
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG03941%27 HTTP/1.1" 200 None
2026-03-28 05:39:16 [auto1.de] INFO: Scrape type for SG03941: 0
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: UC97220
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: RG09784
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: HR87119
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: XH73530
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC28435%27 HTTP/1.1" 200 None
2026-03-28 05:39:16 [auto1.de] INFO: Scrape type for VC28435: 0
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD00479%27 HTTP/1.1" 200 None
2026-03-28 05:39:16 [auto1.de] INFO: Scrape type for AD00479: 0
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: SS53525
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: CA90460
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA90460%27 HTTP/1.1" 200 None
2026-03-28 05:39:16 [auto1.de] INFO: Scrape type for CA90460: 2
2026-03-28 05:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d36c6f08-fcf9-5be2-afbe-769131ea527f with identifier: CA90460
2026-03-28 05:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d36c6f08-fcf9-5be2-afbe-769131ea527f with scrape type 2
2026-03-28 05:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d36c6f08-fcf9-5be2-afbe-769131ea527f with scrape type 2
2026-03-28 05:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d36c6f08-fcf9-5be2-afbe-769131ea527f, identifier: CA90460
2026-03-28 05:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d36c6f08-fcf9-5be2-afbe-769131ea527f with identifier: CA90460
2026-03-28 05:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d36c6f08-fcf9-5be2-afbe-769131ea527f with identifier: CA90460
2026-03-28 05:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d36c6f08-fcf9-5be2-afbe-769131ea527f with identifier: CA90460 to the API
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:59:29Z',
 'fuel_type': 'diesel',
 'id': 'd36c6f08-fcf9-5be2-afbe-769131ea527f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA90460',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 128754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-19',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 116 CDI Pro lang',
 'transmission': 'automatic',
 'trim': 'Pro lang',
 'year': 2019}
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA90460%27 HTTP/1.1" 200 None
2026-03-28 05:39:16 [auto1.de] INFO: Saving data for CA90460: {'auction_closing_time': 1774717169.0, 'created_time': 1774466340.550978, 'last_price_update_time': 1774676356.553641}
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA90460') HTTP/1.1" 204 0
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: SM57605
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61627%27 HTTP/1.1" 200 None
2026-03-28 05:39:16 [auto1.de] INFO: Scrape type for HV61627: 0
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: TD37503
2026-03-28 05:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:18 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: HG98995
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG98995%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for HG98995: 0
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02803%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for WF02803: 0
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: KJ03468
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ03468%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for KJ03468: 2
2026-03-28 05:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fceda173-9371-55ce-b7c7-b60482855d0a with identifier: KJ03468
2026-03-28 05:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fceda173-9371-55ce-b7c7-b60482855d0a with scrape type 2
2026-03-28 05:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fceda173-9371-55ce-b7c7-b60482855d0a with scrape type 2
2026-03-28 05:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fceda173-9371-55ce-b7c7-b60482855d0a, identifier: KJ03468
2026-03-28 05:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fceda173-9371-55ce-b7c7-b60482855d0a with identifier: KJ03468
2026-03-28 05:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fceda173-9371-55ce-b7c7-b60482855d0a with identifier: KJ03468
2026-03-28 05:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fceda173-9371-55ce-b7c7-b60482855d0a with identifier: KJ03468 to the API
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:31:48Z',
 'fuel_type': 'diesel',
 'id': 'fceda173-9371-55ce-b7c7-b60482855d0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ03468',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 140308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-04',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2015}
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ03468%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Saving data for KJ03468: {'auction_closing_time': 1774715508.0, 'created_time': 1774466955.309177, 'last_price_update_time': 1774676358.593323}
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ03468') HTTP/1.1" 204 0
2026-03-28 05:39:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: MU84465
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU84465%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for MU84465: 0
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: KE21243
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE21243%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for KE21243: 0
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: XE92284
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92284%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for XE92284: 0
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: PF58362
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: FP76124
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for NX86319: 0
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: MD04990
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19475%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for NL19475: 0
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: NH29659
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: FW12178
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW12178%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for FW12178: 0
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: XY98739
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY98739%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for XY98739: 2
2026-03-28 05:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0205f338-9f2c-55d7-b63c-7f0e134c42ee with identifier: XY98739
2026-03-28 05:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0205f338-9f2c-55d7-b63c-7f0e134c42ee with scrape type 2
2026-03-28 05:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0205f338-9f2c-55d7-b63c-7f0e134c42ee with scrape type 2
2026-03-28 05:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0205f338-9f2c-55d7-b63c-7f0e134c42ee, identifier: XY98739
2026-03-28 05:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0205f338-9f2c-55d7-b63c-7f0e134c42ee with identifier: XY98739
2026-03-28 05:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0205f338-9f2c-55d7-b63c-7f0e134c42ee with identifier: XY98739
2026-03-28 05:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0205f338-9f2c-55d7-b63c-7f0e134c42ee with identifier: XY98739 to the API
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-28T16:30:15Z',
 'fuel_type': 'petrol',
 'id': '0205f338-9f2c-55d7-b63c-7f0e134c42ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY98739',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 56878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-17',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2021}
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY98739%27 HTTP/1.1" 200 None
2026-03-28 05:39:19 [auto1.de] INFO: Saving data for XY98739: {'auction_closing_time': 1774715415.0, 'created_time': 1774463627.962832, 'last_price_update_time': 1774676359.11903}
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY98739') HTTP/1.1" 204 0
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: CK05183
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: VY08054
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY08054%27 HTTP/1.1" 200 None
2026-03-28 05:39:19 [auto1.de] INFO: Scrape type for VY08054: 0
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: HN30434
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: ZJ77076
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ77076%27 HTTP/1.1" 200 None
2026-03-28 05:39:19 [auto1.de] INFO: Scrape type for ZJ77076: 0
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: SL22871
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: BC91318
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC91318%27 HTTP/1.1" 200 None
2026-03-28 05:39:19 [auto1.de] INFO: Scrape type for BC91318: 2
2026-03-28 05:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53b05eae-9bda-5cfe-8258-a2a14fa3befa with identifier: BC91318
2026-03-28 05:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b05eae-9bda-5cfe-8258-a2a14fa3befa with scrape type 2
2026-03-28 05:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53b05eae-9bda-5cfe-8258-a2a14fa3befa with scrape type 2
2026-03-28 05:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53b05eae-9bda-5cfe-8258-a2a14fa3befa, identifier: BC91318
2026-03-28 05:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53b05eae-9bda-5cfe-8258-a2a14fa3befa with identifier: BC91318
2026-03-28 05:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53b05eae-9bda-5cfe-8258-a2a14fa3befa with identifier: BC91318
2026-03-28 05:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53b05eae-9bda-5cfe-8258-a2a14fa3befa with identifier: BC91318 to the API
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:45:04Z',
 'fuel_type': 'diesel',
 'id': '53b05eae-9bda-5cfe-8258-a2a14fa3befa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC91318',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 161510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2019}
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC91318%27 HTTP/1.1" 200 None
2026-03-28 05:39:19 [auto1.de] INFO: Saving data for BC91318: {'auction_closing_time': 1774716304.0, 'created_time': 1774466323.615853, 'last_price_update_time': 1774676359.73133}
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC91318') HTTP/1.1" 204 0
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: LE21028
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-28 05:39:19 [auto1.de] INFO: Scrape type for VX05177: 2
2026-03-28 05:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177
2026-03-28 05:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b3d7712-a374-5d9e-8caf-726c5516141c with scrape type 2
2026-03-28 05:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b3d7712-a374-5d9e-8caf-726c5516141c with scrape type 2
2026-03-28 05:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b3d7712-a374-5d9e-8caf-726c5516141c, identifier: VX05177
2026-03-28 05:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177
2026-03-28 05:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177
2026-03-28 05:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177 to the API
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:26Z',
 'fuel_type': 'petrol',
 'id': '3b3d7712-a374-5d9e-8caf-726c5516141c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX05177',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 27849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-28 05:39:20 [auto1.de] INFO: Saving data for VX05177: {'auction_closing_time': 1774714406.0, 'created_time': 1773946027.48638, 'last_price_update_time': 1774676360.204866}
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX05177') HTTP/1.1" 204 0
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-28 05:39:20 [auto1.de] INFO: Scrape type for VA96509: 0
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: EN28184
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV83737%27 HTTP/1.1" 200 None
2026-03-28 05:39:20 [auto1.de] INFO: Scrape type for VV83737: 0
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54864%27 HTTP/1.1" 200 None
2026-03-28 05:39:20 [auto1.de] INFO: Scrape type for LN54864: 0
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: MN16875
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: FJ59551
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: AV05824
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV05824%27 HTTP/1.1" 200 None
2026-03-28 05:39:20 [auto1.de] INFO: Scrape type for AV05824: 0
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: JS88024
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: EM02762
2026-03-28 05:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:24 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: DW83875
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: AW09082
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW09082%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for AW09082: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: DR39868
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: XE25364
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY88037%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for ZY88037: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: VS99519
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS99519%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for VS99519: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: BZ38132
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ38132%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for BZ38132: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: MS67851
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS67851%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for MS67851: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ40023%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for BJ40023: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: JY42391
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY42391%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for JY42391: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: RB92475
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: FZ45085
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45085%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for FZ45085: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ57142%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for EJ57142: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: YE52514
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE52514%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for YE52514: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: AK40510
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK40510%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for AK40510: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28932%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for SG28932: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70516%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for PF70516: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: KM46516
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM46516%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for KM46516: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: PM59484
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: YA43957
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA43957%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for YA43957: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: AC23396
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY36184%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for UY36184: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: BV95074
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY67859%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for JY67859: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: DY63135
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY63135%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for DY63135: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: TH48846
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH48846%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for TH48846: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC32924%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for RC32924: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: NE41084
2026-03-28 05:39:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:25 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ91984%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for RZ91984: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ84157%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for GZ84157: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES51146%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for ES51146: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: RU55030
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: WW62013
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: WR30100
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: XV83680
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV83680%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for XV83680: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX49680%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for TX49680: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: YH32821
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: AG95763
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG95763%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for AG95763: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: HB95845
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV43425%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for UV43425: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: WT35488
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT35488%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for WT35488: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: DV40651
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: RT81872
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81872%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for RT81872: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: VF65957
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU14663%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for EU14663: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: NH24337
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: AP35212
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ19896%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for UJ19896: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: FS21817
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: NV29548
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: YC36661
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC36661%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for YC36661: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: FB28212
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB28212%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for FB28212: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: XV50730
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: AB51918
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB51918%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for AB51918: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: WB14215
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: WX47681
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: FN84254
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN84254%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for FN84254: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: VL22817
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM17924%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for WM17924: 0
2026-03-28 05:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:26 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: VV56581
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV56581%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for VV56581: 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: PH05678
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: ZR87762
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR87762%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for ZR87762: 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ46352%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for WZ46352: 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: CG13021
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: SW73326
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW73326%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for SW73326: 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: FH57861
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: NR21385
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: UE28545
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: DP38441
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP38441%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for DP38441: 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: TE81781
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81781%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for TE81781: 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: EZ75910
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86631%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for MW86631: 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: CT92868
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT97457%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for AT97457: 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: WF64949
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF64949%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for WF64949: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: LX19893
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: ED90776
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED90776%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for ED90776: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: XB12574
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: GS10742
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS10742%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for GS10742: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA69463%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for FA69463: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: SB19152
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB19152%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for SB19152: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV58900%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for CV58900: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: VU26933
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: PV39631
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: BE79693
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: EL88156
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL88156%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for EL88156: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: UV51707
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV51707%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for UV51707: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: WJ30276
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ30276%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for WJ30276: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR75909%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for ZR75909: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL60563%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for TL60563: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: HS07572
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS07572%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for HS07572: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-28 05:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:28 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: FG49990
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: EW66655
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW66655%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for EW66655: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: PG72252
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG72252%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for PG72252: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: MA26612
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: ST40572
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST40572%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for ST40572: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY12370%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for WY12370: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46196%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for WJ46196: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: JU35192
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW70056%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for PW70056: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY50059%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for SY50059: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG82543%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for HG82543: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: EL52738
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65606%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for JH65606: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR29242%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for TR29242: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: UC42485
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42485%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for UC42485: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: ZH33487
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH33487%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for ZH33487: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32906%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for PR32906: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for YA52648: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN00313%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for VN00313: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET79003%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for ET79003: 0
2026-03-28 05:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:29 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: NZ73974
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48270%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for NV48270: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for GN89832: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78642%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for VH78642: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for EY51453: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: CG19122
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG19122%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for CG19122: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR77511%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for RR77511: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP80168%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for PP80168: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: TU49372
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49372%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for TU49372: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: US66505
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA76775%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for DA76775: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93130%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for GG93130: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: TZ79275
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ79275%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for TZ79275: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC36065%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for NC36065: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77035%27 HTTP/1.1" 200 None
2026-03-28 05:39:30 [auto1.de] INFO: Scrape type for UR77035: 0
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-28 05:39:30 [auto1.de] INFO: Scrape type for KA83154: 0
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD94440%27 HTTP/1.1" 200 None
2026-03-28 05:39:30 [auto1.de] INFO: Scrape type for KD94440: 0
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: LW88840
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW88840%27 HTTP/1.1" 200 None
2026-03-28 05:39:30 [auto1.de] INFO: Scrape type for LW88840: 0
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP32495%27 HTTP/1.1" 200 None
2026-03-28 05:39:30 [auto1.de] INFO: Scrape type for BP32495: 0
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: TL33635
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53643%27 HTTP/1.1" 200 None
2026-03-28 05:39:30 [auto1.de] INFO: Scrape type for UU53643: 0
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: SX18617
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67874%27 HTTP/1.1" 200 None
2026-03-28 05:39:30 [auto1.de] INFO: Scrape type for MH67874: 0
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: ZS32516
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS32516%27 HTTP/1.1" 200 None
2026-03-28 05:39:30 [auto1.de] INFO: Scrape type for ZS32516: 0
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX28269%27 HTTP/1.1" 200 None
2026-03-28 05:39:30 [auto1.de] INFO: Scrape type for NX28269: 0
2026-03-28 05:39:30 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-28 05:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:32 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: FP85945
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: KZ93271
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: EL64593
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: MJ27519
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: FV38538
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: FJ25741
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB26331%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for DB26331: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: AX65936
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for TN55927: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71101%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for GJ71101: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: US43373
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: GZ32415
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ32415%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for GZ32415: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: JW43504
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: KX05072
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX05072%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for KX05072: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG02124%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for XG02124: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: ST70161
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for JP14233: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: NG47626
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG47626%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for NG47626: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW84966%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for JW84966: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: RU88109
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU88109%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for RU88109: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM50450%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for FM50450: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP03676%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for CP03676: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: ES58004
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97430%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for PB97430: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99572%27 HTTP/1.1" 200 None
2026-03-28 05:39:32 [auto1.de] INFO: Scrape type for MW99572: 0
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-28 05:39:32 [auto1.de] INFO: Found listing with ID: JA32150
2026-03-28 05:39:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:33 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: FP11362
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: XF72259
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP44038%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for BP44038: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: TE65215
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: EN61962
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ01520%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for GZ01520: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC83292%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for FC83292: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: YB27715
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG36075%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for XG36075: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: JB48041
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB48041%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for JB48041: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: VK55236
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD86800%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for GD86800: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: YP75946
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: BE74196
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE74196%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for BE74196: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: MA19340
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA19340%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for MA19340: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK24126%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for BK24126: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: LA55679
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: PW59842
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW59842%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for PW59842: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41202%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for JJ41202: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32254%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for TA32254: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: TE19568
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for KK73289: 0
2026-03-28 05:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:34 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: WZ27773
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27773%27 HTTP/1.1" 200 None
2026-03-28 05:39:34 [auto1.de] INFO: Scrape type for WZ27773: 0
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR66726%27 HTTP/1.1" 200 None
2026-03-28 05:39:34 [auto1.de] INFO: Scrape type for DR66726: 0
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: CG60505
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG60505%27 HTTP/1.1" 200 None
2026-03-28 05:39:34 [auto1.de] INFO: Scrape type for CG60505: 0
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK90767%27 HTTP/1.1" 200 None
2026-03-28 05:39:34 [auto1.de] INFO: Scrape type for AK90767: 0
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93938%27 HTTP/1.1" 200 None
2026-03-28 05:39:34 [auto1.de] INFO: Scrape type for VJ93938: 0
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL01177%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for JL01177: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: JH49592
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78766%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for FJ78766: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28928%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for GP28928: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19595%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for KL19595: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG53147%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for SG53147: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME45713%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for ME45713: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for UC83378: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: HJ47898
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ47898%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for HJ47898: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: JM37060
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: KB63529
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: KC83208
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: DF80401
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF80401%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for DF80401: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: AK10230
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: XF71877
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF71877%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for XF71877: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: GE38296
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE38296%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for GE38296: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: TC10400
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC10400%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for TC10400: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: LW37841
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW37841%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for LW37841: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: UZ23032
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: MU37788
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU37788%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for MU37788: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: ST46361
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST46361%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for ST46361: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: CV46070
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV46070%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for CV46070: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: GE13857
2026-03-28 05:39:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:36 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: YE54237
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE54237%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for YE54237: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: UC90003
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: PM00839
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: RA09675
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: YN58840
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: SR24590
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: WP38302
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP38302%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for WP38302: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: LL32931
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: JR72370
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: LH42937
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH42937%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for LH42937: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: RK58200
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK58200%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for RK58200: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: NW48932
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: CU25460
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU25460%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for CU25460: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: LB53588
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: VU78681
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: NH66638
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH66638%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for NH66638: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: YB76933
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB76933%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for YB76933: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: KB30822
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB30822%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for KB30822: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: UW51602
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: WB23557
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC23372%27 HTTP/1.1" 200 None
2026-03-28 05:39:37 [auto1.de] INFO: Scrape type for YC23372: 0
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: PV88036
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV88036%27 HTTP/1.1" 200 None
2026-03-28 05:39:37 [auto1.de] INFO: Scrape type for PV88036: 0
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: PT29728
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: GR22729
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR22729%27 HTTP/1.1" 200 None
2026-03-28 05:39:37 [auto1.de] INFO: Scrape type for GR22729: 0
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: CH93356
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: FV31347
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: RL64280
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: VS97979
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS97979%27 HTTP/1.1" 200 None
2026-03-28 05:39:37 [auto1.de] INFO: Scrape type for VS97979: 0
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: WJ27645
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ27645%27 HTTP/1.1" 200 None
2026-03-28 05:39:37 [auto1.de] INFO: Scrape type for WJ27645: 0
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: YU45811
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: HJ23200
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: LM35319
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: ND92917
2026-03-28 05:39:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:38 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: GC41711
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN50743%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for BN50743: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: RT85975
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: CZ37102
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ37102%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for CZ37102: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: UN55665
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: SX94415
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX94415%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for SX94415: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: ZH78553
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH78553%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for ZH78553: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: GZ12434
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: EF19771
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF19771%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for EF19771: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: NJ07405
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ07405%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for NJ07405: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: TM10455
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM10455%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for TM10455: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY89352%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for SY89352: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: DM85685
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM85685%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for DM85685: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU60385%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for BU60385: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: EU26166
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU26166%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for EU26166: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: GS88086
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS88086%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for GS88086: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: UH92417
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH92417%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for UH92417: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: ZF36287
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF36287%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for ZF36287: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: UY49029
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for JE28257: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY17492%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for FY17492: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: PB03709
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: MT89119
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT89119%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for MT89119: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: LB55068
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB55068%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for LB55068: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU82814%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for AU82814: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: EV33886
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: DH53095
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: ES20702
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: BR66744
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR66744%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for BR66744: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: SY93073
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: XE28025
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: LB14503
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB14503%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for LB14503: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: DF28999
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28999%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for DF28999: 0
2026-03-28 05:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:39 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: PT66739
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT66739%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for PT66739: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11203%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for UL11203: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: MK93250
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93250%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for MK93250: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: SM85227
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: CG03839
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG03839%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for CG03839: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ55974%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for VJ55974: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: YJ11714
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: NV96108
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV96108%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for NV96108: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: VY22890
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ07162%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for UJ07162: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR81453%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for XR81453: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: DS58679
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN24694%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for MN24694: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU44230%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for PU44230: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: VL80954
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL80954%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for VL80954: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: ZE45705
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45705%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for ZE45705: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: DE08744
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE08744%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for DE08744: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: EN22144
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN22144%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for EN22144: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC78476%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for EC78476: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: LA72906
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA72906%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for LA72906: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: MF16009
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: WK49027
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49027%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for WK49027: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: KG21612
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: YV29892
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: WZ80010
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ80010%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for WZ80010: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: CC70262
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC70262%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for CC70262: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK71200%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for TK71200: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: DV15520
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV15520%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for DV15520: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12343%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for UP12343: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: CT94694
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT94694%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for CT94694: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: VV43208
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV43208%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for VV43208: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: KL57981
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: CU33421
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU33421%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for CU33421: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: PF93593
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF93593%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for PF93593: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: KS12992
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS12992%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for KS12992: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: FH56262
2026-03-28 05:39:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:41 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC31038%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for WC31038: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: MG09905
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG09905%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for MG09905: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: MT78692
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC13487%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for XC13487: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ46252%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for EZ46252: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: LS44265
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD58874%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for KD58874: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: TC94851
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC94851%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for TC94851: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: TM61103
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM61103%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for TM61103: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: KT77585
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: XB19891
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB19891%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for XB19891: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: TJ66673
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ66673%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for TJ66673: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: DH53166
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH53166%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for DH53166: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: ZE31778
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: RD12421
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: RJ07463
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ07463%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for RJ07463: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92244%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for NH92244: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: GE45533
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: GU99476
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: HF74785
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF74785%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for HF74785: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43942%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for HA43942: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: EZ84115
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: CF13145
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF13145%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for CF13145: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: EG69699
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG69699%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for EG69699: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: LZ69181
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ69181%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for LZ69181: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: BC55078
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55078%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for BC55078: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: RL63795
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: WG13195
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG13195%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for WG13195: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: NT25501
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: US44062
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US44062%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for US44062: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45415%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for GP45415: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: PA16133
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: TD01616
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD01616%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for TD01616: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: YV04916
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV04916%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for YV04916: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: ES00815
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES00815%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for ES00815: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66782%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for RP66782: 0
2026-03-28 05:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:42 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: EZ87167
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ87167%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for EZ87167: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: AB91886
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: FZ73081
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: ZZ70477
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ70477%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for ZZ70477: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: FG85844
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG85844%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for FG85844: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: FX17983
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: LE68165
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: XV51445
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: NJ50287
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ50287%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for NJ50287: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: NN96342
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: GX56948
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX56948%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for GX56948: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: MC19465
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC19465%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for MC19465: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: BK94626
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94626%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for BK94626: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: ND36450
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: VB51991
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB51991%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for VB51991: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: NB13742
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: TH46997
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: EW90730
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW90730%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for EW90730: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: VN33107
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: EE21023
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE21023%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for EE21023: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77518%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for LC77518: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: CX63821
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX63821%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for CX63821: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: JL38639
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68072%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for DR68072: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN22748%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for VN22748: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: GR03981
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR03981%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for GR03981: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: GD37496
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD37496%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for GD37496: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: AM26890
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM26890%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for AM26890: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: PU65266
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU65266%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for PU65266: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: PW54296
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW54296%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for PW54296: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: HU83271
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: FR08984
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR08984%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for FR08984: 0
2026-03-28 05:39:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:44 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: ZA36261
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA36261%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for ZA36261: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: WC48972
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC48972%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for WC48972: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for UG40068: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65181%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for YG65181: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE28071%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for GE28071: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: VL97959
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97959%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for VL97959: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: XP39668
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP39668%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for XP39668: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS57219%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for MS57219: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: TE02637
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: AJ02147
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: JW75364
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75364%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for JW75364: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: BY93360
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY93360%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for BY93360: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: LZ33123
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: DW18994
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW18994%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for DW18994: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: TX71823
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX71823%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for TX71823: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: SH29410
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH29410%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for SH29410: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: FP38925
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP38925%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for FP38925: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: FA52681
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA52681%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for FA52681: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: AW42716
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW42716%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for AW42716: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97857%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for YY97857: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: PS70153
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS70153%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for PS70153: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: ZT34226
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: TJ69662
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69662%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for TJ69662: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: GR93204
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: ME49426
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME49426%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for ME49426: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: VH05156
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: AJ94093
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: KN83228
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN83228%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for KN83228: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: SX49755
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-28 05:39:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:45 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: TE58325
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58325%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for TE58325: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: PB84737
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB84737%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for PB84737: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: FX80004
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80004%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for FX80004: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: CK93419
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93419%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for CK93419: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: TT01449
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: RX36269
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: MS42398
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: NX20586
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: TY55277
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY55277%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for TY55277: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: XA91710
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ56060%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for SZ56060: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: KD57513
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD57513%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for KD57513: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: PD68131
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for CG73719: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: LZ01049
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: VY10328
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: RC78324
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: BK70800
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK70800%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for BK70800: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: EN44355
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD91904%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for TD91904: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE35535%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for TE35535: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: SX37933
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for GJ42738: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: ZE74585
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE74585%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for ZE74585: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for ZV29308: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: PA55939
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA55939%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for PA55939: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM69365%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for AM69365: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: BH36406
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV17039%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for VV17039: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY28321%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for MY28321: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-28 05:39:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:46 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: GA16313
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: RC54937
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26961%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for BY26961: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB82704%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for TB82704: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: US61717
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM40362%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for CM40362: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: CN28958
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: KY35163
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: AA47357
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX02891%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for MX02891: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: XU32794
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG72803%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for YG72803: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97741%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for AU97741: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD45301%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for CD45301: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL30880%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for GL30880: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for XX31179: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM06695%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for TM06695: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP61369%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for YP61369: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: TL68134
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68134%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for TL68134: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN72199%27 HTTP/1.1" 200 None
2026-03-28 05:39:47 [auto1.de] INFO: Scrape type for SN72199: 0
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX31727%27 HTTP/1.1" 200 None
2026-03-28 05:39:47 [auto1.de] INFO: Scrape type for ZX31727: 0
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP81674%27 HTTP/1.1" 200 None
2026-03-28 05:39:47 [auto1.de] INFO: Scrape type for KP81674: 0
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-28 05:39:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:48 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: ST20646
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST20646%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for ST20646: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: UF64612
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for TP96640: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: LF59427
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF59427%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for LF59427: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP87344%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for KP87344: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL21879%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for VL21879: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: US56502
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56502%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for US56502: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL79730%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for VL79730: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: AD82327
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for CK84470: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for GH92253: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27977%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for MC27977: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY73359%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for AY73359: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: KE33032
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ78567%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for BZ78567: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for DP54088: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF90530%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for PF90530: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for KD99837: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: EP50641
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT79226%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for JT79226: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX95086%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for SX95086: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: LX99570
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX99570%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for LX99570: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: LA20568
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for MH37188: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH92340%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for JH92340: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR16166%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for TR16166: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF41212%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for VF41212: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for KJ60236: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-28 05:39:49 [auto1.de] INFO: Scrape type for PW80627: 0
2026-03-28 05:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:50 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for UH10138: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA09266%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for MA09266: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: CR14297
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR14297%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for CR14297: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL19525%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for HL19525: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for TE89273: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT58980%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for KT58980: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK35752%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for CK35752: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58383%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for EC58383: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG17958%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for CG17958: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ91980%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for FJ91980: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: EY40312
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: DT18968
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06987%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for AU06987: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP02166%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for VP02166: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for NK84600: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: KD59460
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: AN41725
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41725%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for AN41725: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57196%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for UC57196: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA39123%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for SA39123: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: NN27576
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN27576%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for NN27576: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for KB43733: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: NX98593
2026-03-28 05:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:52 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC01446%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Scrape type for RC01446: 0
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53906%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Scrape type for BR53906: 0
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ17394%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Scrape type for NZ17394: 0
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC97155%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Scrape type for BC97155: 0
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: UK22144
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22144%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for UK22144: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET59047%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for ET59047: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: HF90366
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF90366%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for HF90366: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: LK57137
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK57137%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for LK57137: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for NE52715: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: NA93795
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ30709%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for GZ30709: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF84610%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for UF84610: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT85879%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for DT85879: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: DZ81579
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ81579%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for DZ81579: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN92851%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for FN92851: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08144%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for SG08144: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: ML18265
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: RT17429
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT17429%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for RT17429: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: CN48396
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: FF27762
2026-03-28 05:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:54 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: YY58464
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM89123%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for YM89123: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for ZM52655: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: AM53740
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM53740%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for AM53740: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: EM43051
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: FF42926
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF42926%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for FF42926: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: TR57045
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR57045%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for TR57045: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK33509%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for FK33509: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91859%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for XB91859: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: WM35972
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: LP84561
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH79941%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for CH79941: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU86214%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for MU86214: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: DK79319
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for XJ84301: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01818%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for HL01818: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: PK53003
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: VR97101
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB70808%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for HB70808: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: BM26089
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for SK51641: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: XH45962
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH45962%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for XH45962: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: ME71615
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME71615%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for ME71615: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: TT01725
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT01725%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for TT01725: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: JU24263
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA69574%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for SA69574: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW79588%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for VW79588: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91359%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for HP91359: 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-28 05:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:56 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX12921%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for YX12921: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML19559%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for ML19559: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01467%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for AA01467: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU29731%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for HU29731: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: VD73221
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD73221%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for VD73221: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP85116%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for VP85116: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP55762%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for CP55762: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72052%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for GJ72052: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH40869%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for DH40869: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM25348%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for PM25348: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: YE44037
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE44037%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for YE44037: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN47860%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for SN47860: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: PH72669
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH72669%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for PH72669: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: RX15047
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX15047%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for RX15047: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80532%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for RX80532: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: SY58085
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY58085%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for SY58085: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL07149%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for HL07149: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97095%27 HTTP/1.1" 200 None
2026-03-28 05:39:57 [auto1.de] INFO: Scrape type for PV97095: 0
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA73958%27 HTTP/1.1" 200 None
2026-03-28 05:39:57 [auto1.de] INFO: Scrape type for MA73958: 0
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: SR36375
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR36375%27 HTTP/1.1" 200 None
2026-03-28 05:39:57 [auto1.de] INFO: Scrape type for SR36375: 0
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: YM65091
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-28 05:39:57 [auto1.de] INFO: Scrape type for CR83846: 0
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: DX69622
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC93569%27 HTTP/1.1" 200 None
2026-03-28 05:39:57 [auto1.de] INFO: Scrape type for LC93569: 0
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: ZL39165
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: LX80768
2026-03-28 05:39:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:58 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: JX03592
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX03592%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for JX03592: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26233%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for VH26233: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF35013%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for AF35013: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW30112%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for FW30112: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for AY38359: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: AM12190
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM12190%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for AM12190: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54610%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for HH54610: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: RJ67815
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG36008%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for UG36008: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD67762%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for PD67762: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: ZY51606
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for DX86501: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: RL99236
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: YS34341
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS34341%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for YS34341: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: SR10542
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for HE95833: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW13122%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for FW13122: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: KJ72573
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ72573%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for KJ72573: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT36384%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for KT36384: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: JG05380
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG05380%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for JG05380: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ72661%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for PJ72661: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for VT94173: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for ET45765: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD78649%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for HD78649: 0
2026-03-28 05:39:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:59 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: NP38313
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV04533%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for LV04533: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF30454%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for NF30454: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ62402%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for ZZ62402: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: UR28246
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50102%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for GN50102: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL48230%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for HL48230: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: WE47362
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE47362%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for WE47362: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24569%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for KX24569: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: BP64224
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP64224%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for BP64224: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for VX99653: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN57570%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for DN57570: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG01076%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for VG01076: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for TM25044: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE81559%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for JE81559: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15708%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for KR15708: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25483%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for LJ25483: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: US86443
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for US86443: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: SZ20099
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE29906%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for ZE29906: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: LM23277
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: VM20095
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: WA68038
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68038%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for WA68038: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: TC39973
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39973%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for TC39973: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL93555%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for AL93555: 0
2026-03-28 05:39:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:00 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: YX67220
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX67220%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for YX67220: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: CC63606
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN95717%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for SN95717: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for ZF91540: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR38241%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for DR38241: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: SY49649
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS03842%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for HS03842: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD34962%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for KD34962: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: EA35621
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH16310%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for KH16310: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for SP41663: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for SW23111: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: DB64209
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: XG90247
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG90247%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for XG90247: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM03290%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for LM03290: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR57506%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for HR57506: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC59357%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for DC59357: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52691%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for VY52691: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93100%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for CD93100: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX12116%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for KX12116: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB85475%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for RB85475: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC80403%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for RC80403: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: KN40291
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN40291%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for KN40291: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD44435%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for MD44435: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: EP13780
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP13780%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for EP13780: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST89847%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for ST89847: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: FK17094
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for AV93240: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC04315%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for RC04315: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for WG41390: 0
2026-03-28 05:40:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:02 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: GY29041
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY29041%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for GY29041: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: NB41059
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB41059%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for NB41059: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG67628%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for JG67628: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: YC14273
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC14273%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for YC14273: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK93112%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for PK93112: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93045%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for AE93045: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD73380%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for AD73380: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: UD03401
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD03401%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for UD03401: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW74632%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for PW74632: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR46383%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for RR46383: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF55359%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for CF55359: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU21621%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for KU21621: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88606%27 HTTP/1.1" 200 None
2026-03-28 05:40:03 [auto1.de] INFO: Scrape type for PY88606: 0
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: XY13260
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU04810%27 HTTP/1.1" 200 None
2026-03-28 05:40:03 [auto1.de] INFO: Scrape type for FU04810: 0
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63279%27 HTTP/1.1" 200 None
2026-03-28 05:40:03 [auto1.de] INFO: Scrape type for WC63279: 0
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC13471%27 HTTP/1.1" 200 None
2026-03-28 05:40:03 [auto1.de] INFO: Scrape type for WC13471: 0
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU65331%27 HTTP/1.1" 200 None
2026-03-28 05:40:03 [auto1.de] INFO: Scrape type for JU65331: 0
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: SM01273
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: MW24531
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: XC03196
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC03196%27 HTTP/1.1" 200 None
2026-03-28 05:40:03 [auto1.de] INFO: Scrape type for XC03196: 0
2026-03-28 05:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:04 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: LM23776
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM23776%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for LM23776: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB72145%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for HB72145: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: JX94750
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX94750%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for JX94750: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: HF95044
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for MJ66272: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for HR10562: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for NV40301: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: HY44820
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG96622%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for KG96622: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for KH12936: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ36531%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for DZ36531: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL62984%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for CL62984: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: BC55238
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: EU79522
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79522%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for EU79522: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: GB06112
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB06112%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for GB06112: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09519%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for WE09519: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF61357%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for BF61357: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for SZ04450: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM19192%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for WM19192: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT07076%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for TT07076: 0
2026-03-28 05:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:05 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for UM92745: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD35771%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for AD35771: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF23160%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for PF23160: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: DD75704
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD75704%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for DD75704: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: GD94129
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX17219%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for MX17219: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: LB24374
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB24374%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for LB24374: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: JV29495
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29495%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for JV29495: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY10898%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for TY10898: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: KJ31397
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ31397%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for KJ31397: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for FJ98191: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10464%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for HM10464: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY59901%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for UY59901: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU31630%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for DU31630: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for UR03591: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: MJ97725
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ97725%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for MJ97725: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE86723%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for XE86723: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for JA93486: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57461%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for VJ57461: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for SG10067: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56224%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for KV56224: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: NB03512
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB03512%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for NB03512: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for EG87318: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: YN70037
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: ED74912
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN42361%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for XN42361: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-28 05:40:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:06 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72791%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for CK72791: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03693%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for XK03693: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: RV27328
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: HB28048
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS65923%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for MS65923: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: BJ89189
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20301%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for ZN20301: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: YE63179
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE63179%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for YE63179: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: YJ80540
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ80540%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for YJ80540: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: HT24109
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK16564%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for ZK16564: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: AE54071
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: DS73409
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS73409%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for DS73409: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU57590%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for HU57590: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70846%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for BX70846: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY07264%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for CY07264: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for TG33672: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT26189%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for JT26189: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39713%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for KF39713: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: HV05034
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV05034%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for HV05034: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: KT12988
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for ZG14891: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09054%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for PC09054: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: YG16236
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG16236%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for YG16236: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for NL59823: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE84214%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for AE84214: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67519%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for XY67519: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL05117%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for JL05117: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30155%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for ZL30155: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60481%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for SL60481: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ14861%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for AZ14861: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU33020%27 HTTP/1.1" 200 None
2026-03-28 05:40:07 [auto1.de] INFO: Scrape type for KU33020: 0
2026-03-28 05:40:07 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-28 05:40:07 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV44481%27 HTTP/1.1" 200 None
2026-03-28 05:40:07 [auto1.de] INFO: Scrape type for HV44481: 0
2026-03-28 05:40:07 [scrapy.extensions.logstats] INFO: Crawled 193 pages (at 32 pages/min), scraped 626 items (at 15 items/min)
2026-03-28 05:40:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:40:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:08 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW12270%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for KW12270: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: AZ75969
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: HR56257
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for BS68722: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW33862%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for AW33862: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE63795%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for RE63795: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04951%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for TH04951: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: KA05574
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA05574%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for KA05574: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS86006%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for KS86006: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB44844%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for DB44844: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS08469%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for GS08469: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: VF13288
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS53664%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for NS53664: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: JU03795
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU03795%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for JU03795: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU77879%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for MU77879: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT29598%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for TT29598: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: RB44487
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG70236%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for JG70236: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: GD38856
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73067%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for WK73067: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: KR05534
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR05534%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for KR05534: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS37801%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for BS37801: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF57163%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for TF57163: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-28 05:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:10 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: TU77981
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU77981%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for TU77981: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB91533%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for EB91533: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD36450%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for ZD36450: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93777%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for CK93777: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: HP73171
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP73171%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for HP73171: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW87137%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for HW87137: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH53408%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for GH53408: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: RR39705
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR39705%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for RR39705: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW86422%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for NW86422: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ82398%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for JJ82398: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: RS29820
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29820%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for RS29820: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: HR99105
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for RC86111: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: CJ52428
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52428%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for CJ52428: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF13899%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for NF13899: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for MY97637: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: CX13035
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for UW39505: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05463%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for BN05463: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: FJ74822
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-28 05:40:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:11 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ85797%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for EZ85797: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for WP02035: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: LG96473
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96473%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for LG96473: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for NM50493: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: CC79816
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC26030%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for KC26030: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX71275%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for PX71275: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for NJ46216: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: GH24213
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: WV66084
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV66084%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for WV66084: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: HC51034
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC51034%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for HC51034: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: YY26065
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: LD89298
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD89298%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for LD89298: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: AX72910
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX72910%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for AX72910: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67119%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for VY67119: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: VC37010
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC37010%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for VC37010: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG52240%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for NG52240: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43681%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for YY43681: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for WG78527: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: SB06685
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB06685%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for SB06685: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for CV55682: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-28 05:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:12 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: DV41071
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-28 05:40:12 [auto1.de] INFO: Scrape type for GD44773: 2
2026-03-28 05:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773
2026-03-28 05:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a76b4810-de70-517a-a5a9-5bf0cda02c8d with scrape type 2
2026-03-28 05:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a76b4810-de70-517a-a5a9-5bf0cda02c8d with scrape type 2
2026-03-28 05:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a76b4810-de70-517a-a5a9-5bf0cda02c8d, identifier: GD44773
2026-03-28 05:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773
2026-03-28 05:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773
2026-03-28 05:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773 to the API
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:12:00Z',
 'fuel_type': 'petrol',
 'id': 'a76b4810-de70-517a-a5a9-5bf0cda02c8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD44773',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 180414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-31',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-28 05:40:13 [auto1.de] INFO: Saving data for GD44773: {'auction_closing_time': 1774714320.0, 'created_time': 1773227004.528933, 'last_price_update_time': 1774676413.824311}
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD44773') HTTP/1.1" 204 0
2026-03-28 05:40:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-28 05:40:13 [auto1.de] INFO: Scrape type for XU92987: 0
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ08644%27 HTTP/1.1" 200 None
2026-03-28 05:40:13 [auto1.de] INFO: Scrape type for NJ08644: 0
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: NW01824
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK25344%27 HTTP/1.1" 200 None
2026-03-28 05:40:13 [auto1.de] INFO: Scrape type for YK25344: 0
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: HR15403
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR15403%27 HTTP/1.1" 200 None
2026-03-28 05:40:13 [auto1.de] INFO: Scrape type for HR15403: 0
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: RA84296
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA84296%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for RA84296: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19832%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for RL19832: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for ZA79718: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ52896%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for DZ52896: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: VG06126
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: AG71347
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY93616%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for DY93616: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU96815%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for TU96815: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: ZV51045
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV51045%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for ZV51045: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for TX40216: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY56723%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for ZY56723: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG64287%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for AG64287: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: WM07863
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM07863%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for WM07863: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: RS51050
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS14523%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for NS14523: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB40080%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for AB40080: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-28 05:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:15 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: MT04739
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT04739%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for MT04739: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20233%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for XT20233: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU34226%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for BU34226: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85706%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for LM85706: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU18213%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for UU18213: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS03851%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for WS03851: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: XZ00200
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ00200%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for XZ00200: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: GD72081
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: NN04046
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN04046%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for NN04046: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ32658%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for HZ32658: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD34588%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for WD34588: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for BC55610: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: BB09441
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: AW92079
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90391%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for UZ90391: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW20064%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for VW20064: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for ZL89302: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: RN79752
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN79752%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for RN79752: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: TG99958
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG99958%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for TG99958: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND34621%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for ND34621: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: WV47854
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for RK05347: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: ZJ08773
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA14400%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for DA14400: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for VR69124: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for AZ92098: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU42295%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for TU42295: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM50766%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for TM50766: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for EE83038: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: HY62666
2026-03-28 05:40:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:16 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD00860%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for YD00860: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX44500%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for UX44500: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG63962%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for PG63962: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48468%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for MY48468: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for PY52590: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK41294%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for AK41294: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: PD22194
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD22194%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for PD22194: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV62833%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for AV62833: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ41763%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for VJ41763: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for BJ76765: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50378%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for WY50378: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60092%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for YM60092: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: CZ31886
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: CL03195
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: TN12094
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: PY36433
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for NS82829: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: YX04604
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX04604%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for YX04604: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: SR70263
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: WJ48379
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG07330%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for CG07330: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: NA05625
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: LA17342
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: CP64616
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64616%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for CP64616: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: YV88881
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV88881%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for YV88881: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-28 05:40:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:18 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: XW21261
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW21261%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for XW21261: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77532%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for GA77532: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK35059%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for MK35059: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: RN83637
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: VX93609
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM35887%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for GM35887: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: CY67531
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY67531%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for CY67531: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: EF86082
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF86082%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for EF86082: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for GS86907: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00325%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for YC00325: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: DX83058
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for UG59761: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT71502%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for ZT71502: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: ZA30968
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: RZ98922
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12906%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for RK12906: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: ED07597
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED07597%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for ED07597: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ63993%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for UJ63993: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: TR63216
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: FA61594
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF72599%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for YF72599: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS20731%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for JS20731: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV29491%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for CV29491: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: SP08055
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP08055%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for SP08055: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: YM37957
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM37957%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for YM37957: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG55778%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for VG55778: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for KP94641: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM78395%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for KM78395: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for CV00012: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT94690%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for WT94690: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC75041%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for FC75041: 0
2026-03-28 05:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:19 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for FU20206: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT73600%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for CT73600: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: VX80361
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP15297%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for GP15297: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: VF52184
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF52184%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for VF52184: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS45422%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for PS45422: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP11609%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for UP11609: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98084%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for UY98084: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD03873%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for LD03873: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71410%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for MP71410: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: YU69669
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU69669%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for YU69669: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT51756%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for ZT51756: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS77004%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for RS77004: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER89217%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for ER89217: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for NP05566: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ52700%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for UZ52700: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: ZC13523
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13523%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for ZC13523: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: ZD82611
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE54720%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for VE54720: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: BE55257
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE55257%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for BE55257: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: VD13122
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: ME79930
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME79930%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for ME79930: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: FK15614
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: XG45401
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD80559%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for ZD80559: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: EJ14046
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ14046%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for EJ14046: 0
2026-03-28 05:40:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:21 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: PV53792
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for BS22515: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX61544%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for TX61544: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB16360%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for EB16360: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for RV91936: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ17280%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for UJ17280: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: JB06991
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT74985%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for CT74985: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: NN29635
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN29635%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for NN29635: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: SU34642
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ58938%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for CZ58938: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: GZ05428
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ05428%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for GZ05428: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF69032%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for JF69032: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU35402%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for MU35402: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: CJ40917
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: JA99726
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA99726%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for JA99726: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for LJ53831: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: GJ23792
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ23792%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for GJ23792: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU16541%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for BU16541: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: SJ81609
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: WJ23528
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ23528%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for WJ23528: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: XE45895
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE45895%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for XE45895: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG56142%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for SG56142: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX03008%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for TX03008: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: BN88120
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN88120%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for BN88120: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: YT80911
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT80911%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for YT80911: 0
2026-03-28 05:40:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:22 [auto1.de] INFO: Channel: 24h | Page: 171 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF63031%27 HTTP/1.1" 200 None
2026-03-28 05:40:22 [auto1.de] INFO: Scrape type for KF63031: 0
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: RP62848
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP62848%27 HTTP/1.1" 200 None
2026-03-28 05:40:22 [auto1.de] INFO: Scrape type for RP62848: 0
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP08748%27 HTTP/1.1" 200 None
2026-03-28 05:40:22 [auto1.de] INFO: Scrape type for RP08748: 0
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-28 05:40:22 [auto1.de] INFO: Scrape type for BB54670: 2
2026-03-28 05:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670
2026-03-28 05:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with scrape type 2
2026-03-28 05:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with scrape type 2
2026-03-28 05:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd, identifier: BB54670
2026-03-28 05:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670
2026-03-28 05:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670
2026-03-28 05:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670 to the API
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:56:43Z',
 'fuel_type': 'diesel',
 'id': '78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB54670',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 139161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-18',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Saving data for BB54670: {'auction_closing_time': 1774717003.0, 'created_time': 1773344646.450689, 'last_price_update_time': 1774676423.324243}
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB54670') HTTP/1.1" 204 0
2026-03-28 05:40:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: JJ98035
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER42295%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for ER42295: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81757%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for UL81757: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08526%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for YA08526: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS01662%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for YS01662: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: LN28697
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE25361%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for SE25361: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: JY30766
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for RL83292: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW15548%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for YW15548: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: RF64064
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF48601%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for HF48601: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: EY31921
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY31921%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for EY31921: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: GG87690
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS72141%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for LS72141: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: FA75858
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA75858%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for FA75858: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: WN52333
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: PA40823
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: AA44397
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ86105%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for YZ86105: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD09262%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for CD09262: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for BU81814: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: HU51237
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-28 05:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:24 [auto1.de] INFO: Channel: 24h | Page: 172 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63268%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for GC63268: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41164%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for XJ41164: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: EM52017
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA88514%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for XA88514: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25051%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for CH25051: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG28709%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for CG28709: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ68133%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for JZ68133: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY81223%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for AY81223: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR45011%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for WR45011: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: US51436
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for US51436: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY70159%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for EY70159: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: UD22753
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD22753%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for UD22753: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: UE75515
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE75515%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for UE75515: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN12872%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for RN12872: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ83217%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for UJ83217: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: YF40819
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF40819%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for YF40819: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73401%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for BB73401: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: LD62620
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for LK83365: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: US02257
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08499%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for SX08499: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for FL51955: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR62368%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for HR62368: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for AB72988: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: XJ90591
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: FR11509
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: PE84798
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45065%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for SZ45065: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-28 05:40:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:26 [auto1.de] INFO: Channel: 24h | Page: 173 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: DS16746
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: RY43814
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY43814%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for RY43814: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: ER23285
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER23285%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for ER23285: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU36572%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for MU36572: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: NA61105
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA61105%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for NA61105: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: WM57318
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM57318%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for WM57318: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: CJ16536
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ16536%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for CJ16536: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX84018%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for EX84018: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: FW84422
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: MX67239
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX67239%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for MX67239: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: AM76407
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: XR91127
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR91127%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for XR91127: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR89143%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for HR89143: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: AL22158
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL22158%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for AL22158: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: WK68156
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: FW15775
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: YY67246
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY67246%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for YY67246: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: RM23787
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05980%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for XE05980: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX52309%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for UX52309: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ00942%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for TZ00942: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for XS48010: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: NP91596
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: GZ90473
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: YG40047
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG40047%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for YG40047: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: JA36918
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA36918%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for JA36918: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: UD76012
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD76012%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for UD76012: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: CE30304
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: PD48755
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: DF55322
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55322%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for DF55322: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01619%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for LT01619: 0
2026-03-28 05:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:57 [auto1.de] INFO: Channel: 24h | Page: 174 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: FV18875
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18875%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for FV18875: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41795%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for VE41795: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: BJ39418
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK79004%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for XK79004: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB85775%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for GB85775: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM90118%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for WM90118: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: RB15506
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB15506%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for RB15506: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: ZR64045
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: TZ06235
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ06235%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for TZ06235: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC28656%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for GC28656: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: WS17164
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS17164%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for WS17164: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for FG07323: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: EU47039
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU47039%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for EU47039: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51620%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for VM51620: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL30875%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for UL30875: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: CM43625
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for VR75394: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: PY18559
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: MN13665
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN13665%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for MN13665: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: UJ44809
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: ZC16188
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: SK97361
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: DD55513
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD55513%27 HTTP/1.1" 200 None
2026-03-28 05:40:58 [auto1.de] INFO: Scrape type for DD55513: 0
2026-03-28 05:40:58 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-28 05:40:58 [auto1.de] INFO: Found listing with ID: TT34866
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34866%27 HTTP/1.1" 200 None
2026-03-28 05:40:58 [auto1.de] INFO: Scrape type for TT34866: 0
2026-03-28 05:40:58 [auto1.de] INFO: Found listing with ID: HS97116
2026-03-28 05:40:58 [auto1.de] INFO: Found listing with ID: MW11829
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW11829%27 HTTP/1.1" 200 None
2026-03-28 05:40:58 [auto1.de] INFO: Scrape type for MW11829: 0
2026-03-28 05:40:58 [auto1.de] INFO: Found listing with ID: SZ87491
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ87491%27 HTTP/1.1" 200 None
2026-03-28 05:40:58 [auto1.de] INFO: Scrape type for SZ87491: 0
2026-03-28 05:40:58 [auto1.de] INFO: Found listing with ID: HN55751
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN55751%27 HTTP/1.1" 200 None
2026-03-28 05:40:58 [auto1.de] INFO: Scrape type for HN55751: 0
2026-03-28 05:40:58 [auto1.de] INFO: Found listing with ID: VY03646
2026-03-28 05:40:58 [auto1.de] INFO: Found listing with ID: WY86449
2026-03-28 05:40:58 [auto1.de] INFO: Found listing with ID: WL89525
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL89525%27 HTTP/1.1" 200 None
2026-03-28 05:40:58 [auto1.de] INFO: Scrape type for WL89525: 0
2026-03-28 05:40:58 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-28 05:40:58 [auto1.de] INFO: Scrape type for WY09596: 0
2026-03-28 05:40:58 [auto1.de] INFO: Found listing with ID: XS52651
2026-03-28 05:40:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:59 [auto1.de] INFO: Channel: 24h | Page: 175 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB74234%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for XB74234: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: SZ51903
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: FL69651
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: ZX86337
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX86337%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for ZX86337: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: FP03650
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP03650%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for FP03650: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU12915%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for FU12915: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72840%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for VG72840: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for GT92909: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH72575%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for DH72575: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX05285%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for BX05285: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA11075%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for LA11075: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE80644%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for CE80644: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: LF60633
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF60633%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for LF60633: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: VZ02444
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ02444%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for VZ02444: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: FH65509
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH65509%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for FH65509: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: CU18716
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: WJ85082
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: TF47894
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: MX28919
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP92874%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for AP92874: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: XF17082
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: VZ57974
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ57974%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for VZ57974: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: CU58211
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU58211%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for CU58211: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: CT99178
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: BU19474
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX76120%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for FX76120: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: LX20834
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX20834%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for LX20834: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70879%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for EE70879: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: RS53381
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS53381%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for RS53381: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: FR48233
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR48233%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for FR48233: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: VC03178
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC03178%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for VC03178: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: AT04961
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: DP93170
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP93170%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for DP93170: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: MK25304
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-28 05:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:01 [auto1.de] INFO: Channel: 24h | Page: 176 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: PV23410
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV23410%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for PV23410: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN67073%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for WN67073: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: YT49063
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT49063%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for YT49063: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR18256%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for XR18256: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: FE23921
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE23921%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for FE23921: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21356%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for LK21356: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: RR91619
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR91619%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for RR91619: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: HM21196
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96368%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for TR96368: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: NK67778
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67778%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for NK67778: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: TV50499
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV50499%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for TV50499: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: RT04341
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT04341%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for RT04341: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: LK78383
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78383%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for LK78383: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: RH95863
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH95863%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for RH95863: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: DT99526
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: TL32343
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL32343%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for TL32343: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: NK05730
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK05730%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for NK05730: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: NY96837
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY96837%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for NY96837: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY55649%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for EY55649: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: CW06535
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW06535%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for CW06535: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: SZ37158
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ37158%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for SZ37158: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: ZE95100
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: XK27021
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX50182%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for WX50182: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: NK77096
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK77096%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for NK77096: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: JL68232
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL68232%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for JL68232: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: WN51160
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: ED55965
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED55965%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for ED55965: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: EB27045
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB27045%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for EB27045: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: MB48491
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB48491%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for MB48491: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: JR79236
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: XH89248
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH89248%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for XH89248: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX91762%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for WX91762: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: XM39698
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM39698%27 HTTP/1.1" 200 None
2026-03-28 05:41:01 [auto1.de] INFO: Scrape type for XM39698: 0
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: YP47874
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: AU99982
2026-03-28 05:41:01 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-28 05:41:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:02 [auto1.de] INFO: Channel: 24h | Page: 177 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:02 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-28 05:41:02 [auto1.de] INFO: Found listing with ID: CM78199
2026-03-28 05:41:02 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-28 05:41:02 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-28 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU38157%27 HTTP/1.1" 200 None
2026-03-28 05:41:02 [auto1.de] INFO: Scrape type for NU38157: 0
2026-03-28 05:41:02 [auto1.de] INFO: Found listing with ID: XE06638
2026-03-28 05:41:02 [auto1.de] INFO: Found listing with ID: XC20184
2026-03-28 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC20184%27 HTTP/1.1" 200 None
2026-03-28 05:41:02 [auto1.de] INFO: Scrape type for XC20184: 0
2026-03-28 05:41:02 [auto1.de] INFO: Found listing with ID: TW13952
2026-03-28 05:41:02 [auto1.de] INFO: Found listing with ID: SW03797
2026-03-28 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW03797%27 HTTP/1.1" 200 None
2026-03-28 05:41:02 [auto1.de] INFO: Scrape type for SW03797: 0
2026-03-28 05:41:02 [auto1.de] INFO: Found listing with ID: MG59834
2026-03-28 05:41:02 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-28 05:41:02 [auto1.de] INFO: Found listing with ID: LU31167
2026-03-28 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU31167%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for LU31167: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: EK22988
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK22988%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for EK22988: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: DA26658
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA26658%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for DA26658: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: LN54232
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54232%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for LN54232: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD29565%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for DD29565: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: UL22027
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: GA30636
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA30636%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for GA30636: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: JZ10962
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: NF93204
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: KK91293
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for DL45560: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for RC52895: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: UM89266
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM89266%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for UM89266: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: CV45473
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: RD20926
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY11895%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for WY11895: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: BE69284
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: VE40725
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE40725%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for VE40725: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: KM24929
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR35436%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for CR35436: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: FS97701
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS97701%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for FS97701: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: DF26207
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60682%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for LL60682: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for ZT53548: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: GA77173
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77173%27 HTTP/1.1" 200 None
2026-03-28 05:41:03 [auto1.de] INFO: Scrape type for GA77173: 0
2026-03-28 05:41:03 [auto1.de] INFO: Found listing with ID: YZ37730
2026-03-28 05:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:04 [auto1.de] INFO: Channel: 24h | Page: 178 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84007%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for ZX84007: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: XX78597
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX78597%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for XX78597: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93130%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for WG93130: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: LN26103
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: AN38948
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: KZ05570
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: YV73538
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73538%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for YV73538: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: LW15406
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR74961%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for TR74961: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK54405%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for SK54405: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: KU78731
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: PN43025
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: TW48699
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: HX62620
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: PD71224
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD71224%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for PD71224: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: DN90416
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: GG89436
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: SJ33830
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ33830%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for SJ33830: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: NE75834
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: RL39827
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL39827%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for RL39827: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95124%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for EY95124: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: AB28223
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: CN50169
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for CM74095: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC82982%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for NC82982: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: HH76288
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH76288%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for HH76288: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS81826%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for CS81826: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: US13530
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US13530%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for US13530: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF79557%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for WF79557: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY99054%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for MY99054: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for YP37345: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: GX42293
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX42293%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for GX42293: 0
2026-03-28 05:41:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:06 [scrapy.extensions.logstats] INFO: Crawled 210 pages (at 17 pages/min), scraped 628 items (at 2 items/min)
2026-03-28 05:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:09 [auto1.de] INFO: Channel: 24h | Page: 179 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: YY09343
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY09343%27 HTTP/1.1" 200 None
2026-03-28 05:41:09 [auto1.de] INFO: Scrape type for YY09343: 0
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD20559%27 HTTP/1.1" 200 None
2026-03-28 05:41:09 [auto1.de] INFO: Scrape type for DD20559: 0
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: ML17835
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML17835%27 HTTP/1.1" 200 None
2026-03-28 05:41:09 [auto1.de] INFO: Scrape type for ML17835: 0
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW33443%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for RW33443: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH20515%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for LH20515: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: GW12084
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF09149%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for CF09149: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34642%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for CA34642: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61675%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for GL61675: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: CL86241
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67104%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for MV67104: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86869%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for YB86869: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for WS48459: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB13325%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for HB13325: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for TK89149: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW41048%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for FW41048: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26855%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for CR26855: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: UR07800
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR07800%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for UR07800: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: KD93496
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD93496%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for KD93496: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT11512%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for TT11512: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: AL86714
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL86714%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for AL86714: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA02220%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for JA02220: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT58518%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for YT58518: 0
2026-03-28 05:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:11 [auto1.de] INFO: Channel: 24h | Page: 180 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82659%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for PS82659: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: CX20587
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91638%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for FY91638: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: SJ16961
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: VV03137
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03137%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for VV03137: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for VE80218: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: ZS51994
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS51994%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for ZS51994: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for BX54451: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD76809%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for CD76809: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY67479%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for GY67479: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU29174%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for VU29174: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: NP21854
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: NT84064
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV65946%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for DV65946: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ75418%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for KJ75418: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27020%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for NT27020: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE20553%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for JE20553: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY50821%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for CY50821: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: NB66943
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB66943%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for NB66943: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: NK75745
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: XT22823
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT22823%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for XT22823: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: AX94045
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX94045%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Scrape type for AX94045: 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: DZ46281
2026-03-28 05:41:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:12 [auto1.de] INFO: Channel: 24h | Page: 181 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: XF90946
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF90946%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for XF90946: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL65156%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for TL65156: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG55591%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for JG55591: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF74811%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for ZF74811: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: NJ92771
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ92771%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for NJ92771: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP93259%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for YP93259: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for NW62126: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC45462%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for SC45462: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU09743%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for XU09743: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC31654%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for UC31654: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90427%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for FU90427: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: AE68342
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE68342%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for AE68342: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for CC98998: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX02497%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for PX02497: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: AX67376
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX67376%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for AX67376: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE72170%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for KE72170: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY02769%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for KY02769: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU39152%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for BU39152: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM38204%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for EM38204: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: VW08133
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: LC14083
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC14083%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for LC14083: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: PM13070
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM13070%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for PM13070: 0
2026-03-28 05:41:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:14 [auto1.de] INFO: Channel: 24h | Page: 182 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: FN69423
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN69423%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for FN69423: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC45623%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for WC45623: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: EF60692
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: DR21754
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC27244%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for FC27244: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG34789%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for AG34789: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: YL43717
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for UE90964: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: FH11160
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH11160%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for FH11160: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS43037%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for MS43037: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH34813%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for MH34813: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: ZM43235
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW05271%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for LW05271: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: FP53719
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP53719%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for FP53719: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30893%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for TA30893: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84142%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for NV84142: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: EX24606
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: AE65824
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: GE88369
2026-03-28 05:41:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:15 [auto1.de] INFO: Channel: 24h | Page: 183 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for RZ09497: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: TG88062
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB28845%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for DB28845: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23658%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for PR23658: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68536%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for KW68536: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF27156%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for BF27156: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: XG19073
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31495%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for BA31495: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR13595%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for HR13595: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE98572%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for KE98572: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78098%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for UW78098: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: VV99941
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV99941%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for VV99941: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: BY90710
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: KV84804
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA07254%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for VA07254: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: MT40428
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT40428%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for MT40428: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ16106%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for HZ16106: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for YJ47160: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL07101%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for GL07101: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT61440%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for HT61440: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX89038%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for GX89038: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL88078%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for NL88078: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: VZ21746
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: PD92865
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD92865%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for PD92865: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: TR81409
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for MN30127: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: TF66313
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF66313%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for TF66313: 0
2026-03-28 05:41:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:16 [auto1.de] INFO: Channel: 24h | Page: 184 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: CZ12085
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ12085%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for CZ12085: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for YA08912: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for CJ52783: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for EH62859: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for FY64526: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for GX15527: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for YL92844: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for WG78869: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: BX52233
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for WM31367: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for MG37810: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for NK83819: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: SV13508
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: TE41931
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE41931%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for TE41931: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for PD33755: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for MW31978: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for WM50806: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: VM88505
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for FJ71041: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for RT27360: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: LA39027
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: EM63340
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM63340%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for EM63340: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for TL42173: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for MB94614: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: KY59799
2026-03-28 05:41:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:18 [auto1.de] INFO: Channel: 24h | Page: 185 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: NG10221
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for ZK28238: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for YW88691: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for RE17232: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: HK36179
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for UE30876: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: DF69059
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF69059%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for DF69059: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for WG00954: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: ZK69536
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK69536%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for ZK69536: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for BD44201: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: NG01563
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG01563%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for NG01563: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: XX11179
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX11179%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for XX11179: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: HK63697
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for AU27688: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: RM96597
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for JU23189: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: LW83066
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW83066%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for LW83066: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for LX68947: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for CT44889: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for GS69685: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for AE12757: 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: NC61336
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC61336%27 HTTP/1.1" 200 None
2026-03-28 05:41:18 [auto1.de] INFO: Scrape type for NC61336: 0
2026-03-28 05:41:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:19 [auto1.de] INFO: Channel: 24h | Page: 186 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: BY27711
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for CK79873: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: CD24001
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for MV69505: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: FR69790
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for KS26285: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: NH03698
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH03698%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for NH03698: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: SC33158
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC33158%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for SC33158: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for WY54008: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for WE78461: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: XX31314
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31314%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for XX31314: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: ZA85073
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: UK16576
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK16576%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for UK16576: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: HL17570
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL17570%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for HL17570: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: BZ40542
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for KP27245: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: LF68869
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF68869%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for LF68869: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for HF06660: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-28 05:41:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:20 [auto1.de] INFO: Channel: 24h | Page: 187 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: RF57736
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-28 05:41:20 [auto1.de] INFO: Scrape type for GY26864: 0
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: JL47940
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL47940%27 HTTP/1.1" 200 None
2026-03-28 05:41:20 [auto1.de] INFO: Scrape type for JL47940: 0
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for VT76935: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: ZD23716
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23716%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for ZD23716: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for ZG00412: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for XL45586: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for MC50567: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: RG24592
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for MK74159: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for JZ96778: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for GB74339: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for YS13064: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for DW23670: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for TL45864: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for BE44691: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for JM99769: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for GB59587: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: WN28352
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for FX80624: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for AF42457: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for ES42650: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for EA13561: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for GH02109: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: TR96754
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96754%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for TR96754: 0
2026-03-28 05:41:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:22 [auto1.de] INFO: Channel: 24h | Page: 188 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:22 [auto1.de] INFO: Found listing with ID: RP70991
2026-03-28 05:41:22 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-28 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-28 05:41:22 [auto1.de] INFO: Scrape type for SS89253: 0
2026-03-28 05:41:22 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-28 05:41:22 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-28 05:41:22 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-28 05:41:22 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for JN13946: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for PV56207: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for JS13151: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for WR99181: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05460%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for VT05460: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for LV46830: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: SJ46577
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ46577%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for SJ46577: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for FE22716: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: VM88719
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM88719%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for VM88719: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: BB84550
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: YV97613
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV97613%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for YV97613: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for PT90816: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for JY33610: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: ZC71941
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for DW75956: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for JT94626: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: XK99060
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK99060%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for XK99060: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for SA10285: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for EN90928: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: LA44092
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA44092%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for LA44092: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for JL12737: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: GL18465
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for AX51342: 0
2026-03-28 05:41:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:24 [auto1.de] INFO: Channel: 24h | Page: 189 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for HJ55484: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for MW22662: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for HB69443: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: MV22283
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV22283%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for MV22283: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: WT41205
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT41205%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for WT41205: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: DA44697
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for AU24928: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for BK59777: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for FB09525: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: NL50541
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL50541%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for NL50541: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for AB87355: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for NX68666: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for JT97344: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for GE37655: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for FF90181: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: VX15127
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: RS38976
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS38976%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for RS38976: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for ZU85888: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: VW35628
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW35628%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for VW35628: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: DE80885
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for BN48826: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: LR18629
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR18629%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for LR18629: 0
2026-03-28 05:41:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:25 [auto1.de] INFO: Channel: 24h | Page: 190 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: XS57001
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for BB33034: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for ZW26780: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: PA36365
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA36365%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for PA36365: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for KC35382: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for EX72807: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for EG01443: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for KL31894: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for VD47640: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for DU13341: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for WC36574: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for XB85584: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: HB67521
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67521%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for HB67521: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for SE52893: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: ZN32695
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for SD86365: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for LF03511: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: MK03700
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: FK77468
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for PN22226: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: AG44420
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44420%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for AG44420: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for MJ13308: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for WC63339: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: LL66179
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL66179%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for LL66179: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: VP53971
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP53971%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for VP53971: 0
2026-03-28 05:41:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:26 [auto1.de] INFO: Channel: 24h | Page: 191 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-28 05:41:26 [auto1.de] INFO: Scrape type for DE09566: 0
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: FB90112
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: JW30909
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-28 05:41:26 [auto1.de] INFO: Scrape type for NR35268: 0
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for VE41412: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for BX01003: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for HK20534: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: UF20593
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF20593%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for UF20593: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for CC81369: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: UN23019
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN23019%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for UN23019: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for EK21596: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: AC15853
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for SD28198: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for NG44703: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: LU27790
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for HP18010: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: VC15219
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC15219%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for VC15219: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for GA58010: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: SJ87943
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for DF59303: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: MA93398
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for TU49821: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for CG74532: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for DF30572: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for CK07133: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: TX89120
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for XH18940: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-28 05:41:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:28 [auto1.de] INFO: Channel: 24h | Page: 192 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for BE25239: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for JN21638: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: HL08327
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL08327%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for HL08327: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: PS35101
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for PM23375: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for UZ37067: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for WY87564: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for SC06812: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for YF78558: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: LA14502
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA14502%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for LA14502: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for GC05156: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for GT57416: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for FR92717: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for TA25367: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for RN18911: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for DF38507: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for SC10304: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for GM45973: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for YM57013: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: BR67018
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: EA75512
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for VF83806: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for AR33954: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: FL90187
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL90187%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for FL90187: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for WB38942: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for XT08525: 0
2026-03-28 05:41:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:30 [auto1.de] INFO: Channel: 24h | Page: 193 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: EX64550
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX64550%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for EX64550: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: FZ93202
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ93202%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for FZ93202: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: ML20845
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML20845%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for ML20845: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for BN78852: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for ZT20326: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: VG97349
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG97349%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for VG97349: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: BK65604
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: EP70088
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for WS02654: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for VB62953: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for LE21956: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for EY23363: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for MU47356: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for FL14438: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for HA69467: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for PY44699: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for ZV33449: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for SA55190: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: BG14243
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for JK17459: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for HG45518: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for KR60146: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: CA31330
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31330%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for CA31330: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for SX60280: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for UU73518: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for UM95943: 0
2026-03-28 05:41:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:31 [auto1.de] INFO: Channel: 24h | Page: 194 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for HJ94843: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: NW54336
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for PF67152: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for JK31212: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for XR58128: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for ZU59417: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for LX86336: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for HK68029: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for GY96570: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for EG34201: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for AL71232: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for PH16330: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for BJ03907: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for HH61225: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for CC89371: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for VG26326: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for LL88784: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: HW66490
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW66490%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for HW66490: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: UH98886
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for XC17243: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for HZ19691: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: NV75211
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for PZ27483: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-28 05:41:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:32 [auto1.de] INFO: Channel: 24h | Page: 195 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Scrape type for ZK39912: 0
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: JU74172
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Scrape type for DD89889: 0
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Scrape type for TK47054: 0
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Scrape type for LJ75768: 0
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Scrape type for GL59385: 0
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Scrape type for FF62684: 0
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Scrape type for NS47503: 0
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Scrape type for TX48260: 0
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: KU06936
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU06936%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Scrape type for KU06936: 0
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Scrape type for KM87247: 0
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Scrape type for PS47170: 0
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: NN29334
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN29334%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Scrape type for NN29334: 0
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Scrape type for EV39961: 0
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Scrape type for WY91699: 0
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Scrape type for SR51449: 0
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Scrape type for DT77440: 0
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Scrape type for KW79987: 0
2026-03-28 05:41:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:34 [auto1.de] INFO: Channel: 24h | Page: 196 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: YU96411
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU96411%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for YU96411: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for AD28287: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for HJ11294: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for LU16486: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: RU03073
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU03073%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for RU03073: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for JX81073: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for GD60404: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for BF57036: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for UH99848: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for XF55006: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for MY70814: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for HG64056: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for PK39186: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for LR76257: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for YE81869: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for PF97511: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for HX00306: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: DT83749
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for XG94093: 0
2026-03-28 05:41:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:36 [auto1.de] INFO: Channel: 24h | Page: 197 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for XK87583: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for PU26229: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for VX14818: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for LM98964: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for ZR39643: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for LS36397: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for DD70281: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for CM33145: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for KR04535: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for PE91450: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for BV55429: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for HT48359: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: TF25150
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF25150%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for TF25150: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for HS66521: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for YR07443: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for EJ40099: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for KS23837: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for NY67891: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for FY25163: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for WD77905: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for CY56514: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for ZY38898: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: US02416
2026-03-28 05:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:37 [auto1.de] INFO: Channel: 24h | Page: 198 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for NX41680: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for AH37368: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: CV35791
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for GM59511: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for HF47887: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: WP35313
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP35313%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for WP35313: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for AU29418: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for CV64840: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for MV92547: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for ND18169: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for UE28952: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for RZ86023: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for ML83071: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for DF17432: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for NB05774: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS62021%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for JS62021: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for FD55088: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for YN10477: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for BS14183: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for KJ55573: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for UN13511: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for SF39323: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-28 05:41:38 [auto1.de] INFO: Scrape type for JV68921: 0
2026-03-28 05:41:38 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-28 05:41:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:39 [auto1.de] INFO: Channel: 24h | Page: 199 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for TU97792: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for VG31593: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for DS71504: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for ZE41577: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: DM09688
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM09688%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for DM09688: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for EJ65167: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for FC63717: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for EN50331: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: GT54447
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54447%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for GT54447: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for UC48235: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for PD80009: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for PZ11168: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for LB22457: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: TW84588
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW84588%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for TW84588: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: VM43459
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for RR18814: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for EE19276: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for NR67134: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for UJ33462: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for TC26510: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for YA68492: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for BD72910: 0
2026-03-28 05:41:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:40 [auto1.de] INFO: Channel: 24h | Page: 200 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for NA53807: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for MZ26894: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: HV11819
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for UX10113: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: NE66332
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for RJ15430: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: FU30780
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU30780%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for FU30780: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for BD12559: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for DB46013: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for RF33157: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: HE81981
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE81981%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for HE81981: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for AB49272: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: ZN02812
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN02812%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for ZN02812: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for BW18754: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for MF02392: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for BN30919: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for SG28437: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for DE69910: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: SX47208
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX47208%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for SX47208: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: UN34708
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN34708%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for UN34708: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for JB86141: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for GG89012: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: LG78390
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG78390%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for LG78390: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for BX10295: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for EF82631: 0
2026-03-28 05:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:41 [auto1.de] INFO: Channel: 24h | Page: 201 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:41 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-28 05:41:41 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-28 05:41:41 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for HU16718: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for HA99169: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for VY38504: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: ZV87570
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV87570%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for ZV87570: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for AV25336: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for YV09971: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for SJ02075: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for CT53994: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for BZ09697: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for DM27996: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for TL87064: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for WS69855: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for DB25597: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for LT47109: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for ZT78140: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for SY85938: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for WP81367: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for VS89530: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for DU96107: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for EJ80862: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for YS06113: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for BP65975: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-28 05:41:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:43 [auto1.de] INFO: Channel: 24h | Page: 202 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for JJ95706: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for VJ30367: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for RJ05854: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for SD97280: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for YT67181: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for SG31546: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for HE92439: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: FP37093
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP37093%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for FP37093: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for RV99753: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: RZ61544
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for WT86563: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for HT39177: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for TF11415: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for YH44518: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for ER78775: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for PS26933: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for ZZ59930: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for CE41516: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for TT79830: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for GM12066: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for NM34350: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for FZ89308: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for EC74122: 0
2026-03-28 05:41:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:44 [auto1.de] INFO: Channel: 24h | Page: 203 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for LH09734: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for XU64075: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for LU00556: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for MU33695: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for LH51780: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for VG52113: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for LU75285: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for AJ71122: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for SV69616: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: CH61883
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH61883%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for CH61883: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for ZN63350: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for CW59742: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for GV91046: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: LK48428
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK48428%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for LK48428: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for HM04457: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for WP61796: 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-28 05:41:45 [auto1.de] INFO: Scrape type for DE42625: 0
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-28 05:41:45 [auto1.de] INFO: Scrape type for AX24898: 0
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-28 05:41:45 [auto1.de] INFO: Scrape type for FA59135: 0
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-28 05:41:45 [auto1.de] INFO: Scrape type for MU44330: 0
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-28 05:41:45 [auto1.de] INFO: Scrape type for KX79678: 0
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-28 05:41:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:46 [auto1.de] INFO: Channel: 24h | Page: 204 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for JY04435: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for YJ23133: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for SD67792: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for ET35150: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for JW09174: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for SA82608: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for EH74831: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for DK31638: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for CA50565: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for XR26970: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for UE57150: 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for LT21646: 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for WP04220: 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for HB50510: 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for XP96351: 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for EP38579: 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for BJ60837: 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: EJ54624
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ54624%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for EJ54624: 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-28 05:41:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:48 [auto1.de] INFO: Channel: 24h | Page: 205 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for VN95277: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for TJ67594: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for YN35790: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for DW90276: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for CF02627: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for SR77795: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for BS26605: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for NV13181: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for EC25925: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for VX34650: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for XM89515: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for DW00961: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for DU27539: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for MC22222: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for KF91285: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for WV94095: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for RB77182: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for TV17454: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-28 05:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:49 [auto1.de] INFO: Channel: 24h | Page: 206 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for JU77482: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for NX68514: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for BV74864: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for TU33144: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for CW96119: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for YN77653: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: TR21109
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for ZV84359: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for ZL15649: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for VX13516: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for JL65692: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for GA75258: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: EX10887
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX10887%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for EX10887: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for WT60095: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for HS53864: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for AH97983: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for ED00109: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: TV77789
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV77789%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for TV77789: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for XR43208: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for KN65444: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for LK29782: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for SC70285: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for CZ94450: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for TF63689: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for WW16724: 0
2026-03-28 05:41:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:50 [auto1.de] INFO: Channel: 24h | Page: 207 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for EB33579: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for DX68266: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for TF26076: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for TV60687: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: KL29911
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL29911%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for KL29911: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: TH70911
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH70911%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for TH70911: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: CK84203
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84203%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for CK84203: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for ZE40568: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for FK97856: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for WE44185: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for NN66597: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for XB90216: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for LB47051: 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for NR01003: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for LL09257: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for AR53020: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for SA06109: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for AE21884: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for SZ48596: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for YH85992: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-28 05:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:52 [auto1.de] INFO: Channel: 24h | Page: 208 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for EC33073: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for LR06917: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for CR11100: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for NY09817: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for SL47086: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for VN06043: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for EB01944: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for TF52264: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for TY82930: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for ND33880: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for TU29288: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for EZ94089: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for YT04304: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for CZ89661: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for XN32134: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for ZS84546: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for SH26484: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for DJ32425: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for HX34455: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for DV91076: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for ZU26768: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-28 05:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:53 [auto1.de] INFO: Channel: 24h | Page: 209 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for RX21062: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for GU43225: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for FD07804: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for FC29722: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for LG31115: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for NY75190: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for TB49418: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for HX44464: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: DC16754
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC16754%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for DC16754: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: PE37736
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for GR86063: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: YM75197
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM75197%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for YM75197: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for XS50717: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for UL70410: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for KM66171: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: TK73674
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK73674%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for TK73674: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for GK51404: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for CT00605: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for XF83287: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for YL63918: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for LJ65077: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for TN14580: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for ZU42459: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for AN13363: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for GJ36407: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-28 05:41:54 [auto1.de] INFO: Scrape type for NW35011: 0
2026-03-28 05:41:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:55 [auto1.de] INFO: Channel: 24h | Page: 210 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for YD09657: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for XN51512: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for NM84530: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for MS73974: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for VN46305: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for AS21942: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for RD63050: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for JK39186: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for TV11727: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for HX75388: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for FK87284: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for EX44757: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for UX30716: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for CE68759: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for BZ96817: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: LZ15789
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ15789%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for LZ15789: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for DE42572: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for TV18739: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for PN31203: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: ZG62657
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG62657%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for ZG62657: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for FC76019: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for JG35044: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for FG09102: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for BY18365: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for BE52525: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for MB36683: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for PT08625: 0
2026-03-28 05:41:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:56 [auto1.de] INFO: Channel: 24h | Page: 211 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for PG24864: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: YD14218
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD14218%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for YD14218: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for SG17640: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for YZ38333: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for AB26225: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for SE32009: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for RR41525: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for ZV40367: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for GS33010: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for LK17231: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for YJ71992: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for CJ15757: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for PZ40966: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for ED19748: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for WP48150: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Scrape type for MZ72792: 0
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Scrape type for DH13363: 0
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Scrape type for YE69852: 0
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Scrape type for KT10840: 0
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Scrape type for PA97502: 0
2026-03-28 05:41:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:58 [auto1.de] INFO: Channel: 24h | Page: 212 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-28 05:41:58 [auto1.de] INFO: Scrape type for ZS46633: 0
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-28 05:41:58 [auto1.de] INFO: Scrape type for DW94281: 0
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-28 05:41:58 [auto1.de] INFO: Scrape type for ZL76152: 0
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-28 05:41:58 [auto1.de] INFO: Scrape type for XM62598: 0
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-28 05:41:58 [auto1.de] INFO: Scrape type for LV98525: 0
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-28 05:41:58 [auto1.de] INFO: Scrape type for CV89057: 0
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for VL85665: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for EC38320: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for KK20650: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for ZY62714: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for UB45914: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: WL25699
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for CM72901: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for FT64995: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for TD54604: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for HA10430: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for DJ74169: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for GA26329: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for LD79531: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for GN68043: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for WX41369: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for HE96933: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for XW28946: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for ZC62608: 0
2026-03-28 05:41:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:00 [auto1.de] INFO: Channel: 24h | Page: 213 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: PU35807
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU35807%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for PU35807: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for AH71943: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for WJ12441: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for HX82785: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for ZA19141: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for BB20328: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for GE94001: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for BA36034: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for DN11419: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for HL77146: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for RM91715: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for BX52940: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for HA89104: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for XB63753: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for FV41920: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for XB43693: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for NZ04570: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for JR30174: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for VL16221: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for LD21016: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for WK73698: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: MM87204
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM87204%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for MM87204: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for DE85774: 0
2026-03-28 05:42:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:01 [auto1.de] INFO: Channel: 24h | Page: 214 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for XG77480: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for LZ09190: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for KF55313: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for YU55800: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for MM23773: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for PE27590: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for PY37454: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: ZZ72723
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for SX51992: 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for ZA74558: 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: VX77382
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77382%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for VX77382: 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for KX42000: 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for AJ88373: 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: DG23349
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23349%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for DG23349: 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: TG62557
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for PL78300: 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for XD56030: 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for FF92976: 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for CN67479: 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-28 05:42:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:06 [scrapy.extensions.logstats] INFO: Crawled 246 pages (at 36 pages/min), scraped 628 items (at 0 items/min)
2026-03-28 05:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:16 [auto1.de] INFO: Channel: 24h | Page: 215 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for UW00779: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for BB05749: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for ZX08266: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for LK12001: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for AL51386: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for FV26342: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: PK01210
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK01210%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for PK01210: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for BW77657: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for BL84965: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for ML06015: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for NR72053: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: NN07588
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN07588%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for NN07588: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for BD98070: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for EL73218: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for BR95231: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for JX40120: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-28 05:42:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:17 [auto1.de] INFO: Channel: 24h | Page: 216 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for GC03067: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for XW85438: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for AT56964: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for SD97689: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for PN78353: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for EV07676: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: RY40991
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY40991%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for RY40991: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for TB03124: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for NG37948: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for YH81029: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for JG82377: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for LF15442: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for WG70910: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for ZH54779: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for GE03555: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for YY49162: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for HT64251: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for JL85877: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for EC36203: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for JC56914: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for LU78971: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for PW95662: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for MW62166: 0
2026-03-28 05:42:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:18 [auto1.de] INFO: Channel: 24h | Page: 217 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:18 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-28 05:42:18 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for EV99140: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for BP82527: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for CA11296: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for LP67164: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for LT72401: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for JV37620: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: WA42896
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for LA05422: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for XN26192: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for TJ09014: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for NX72393: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for KV75239: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for SV37503: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for XG51341: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for EU55937: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for BF85943: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for NS04983: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for GH47357: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for CA65369: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for BD43064: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for UF29194: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for GV91786: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for TN59671: 0
2026-03-28 05:42:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:20 [auto1.de] INFO: Channel: 24h | Page: 218 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: EJ47665
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for GK53222: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for GK41748: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: LB73186
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB73186%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for LB73186: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for NC65519: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for WB73740: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for CN87800: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for NF34057: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for AW17852: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for ZK30866: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for YS21206: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: ZN72039
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for VC63070: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for RS52465: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: ME69590
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME69590%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for ME69590: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for FK93583: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for YF25460: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for NM28513: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for YT48598: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for XY70185: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for YW59624: 0
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Scrape type for RG82987: 0
2026-03-28 05:42:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:21 [auto1.de] INFO: Channel: 24h | Page: 219 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Scrape type for MG28857: 0
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Scrape type for JT86021: 0
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Scrape type for PL48246: 0
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for LC91854: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for ZF67159: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for PL89727: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for LK50983: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for EF84485: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: SP58738
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP58738%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for SP58738: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: TZ19731
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ19731%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for TZ19731: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for VW82123: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for RP50374: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for XD11713: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for WD55568: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for NV33173: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for YT60499: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for HS55483: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for XE26333: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for FZ40219: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for GM47642: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for FM56481: 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for GG14507: 0
2026-03-28 05:42:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:27 [auto1.de] INFO: Channel: 24h | Page: 220 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for RV05301: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: MY83778
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY83778%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for MY83778: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for TL69510: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for WW79477: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for YA95886: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for VS86742: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for BN16879: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for JS31219: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for CC89680: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for BR76788: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for CG27437: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for BK33721: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: RY91150
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for NT60185: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for NY07773: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for EB92999: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for XJ26035: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for KL53261: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for EU72034: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for UX71045: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for NC35007: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for FB31140: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for YS81277: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-28 05:42:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:28 [auto1.de] INFO: Channel: 24h | Page: 221 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for BA73417: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for DF02739: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for JF95451: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for ZT19745: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for YE46941: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for TE39343: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for KH46132: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: US92808
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for US92808: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: AB79504
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB79504%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for AB79504: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for ZM88975: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for TJ16115: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for RS52276: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for GN84809: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for DX61886: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for AK65785: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for AK97582: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for GE73392: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for EJ25575: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: WJ93096
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ93096%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for WJ93096: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for PE74408: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for UY58997: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: GG04913
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG04913%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for GG04913: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for ZS47676: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for JL44277: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-28 05:42:29 [auto1.de] INFO: Scrape type for KB62018: 0
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-28 05:42:29 [auto1.de] INFO: Scrape type for EG39650: 0
2026-03-28 05:42:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:29 [auto1.de] INFO: Channel: 24h | Page: 222 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-28 05:42:29 [auto1.de] INFO: Scrape type for ZV64166: 0
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-28 05:42:29 [auto1.de] INFO: Scrape type for EC93517: 0
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-28 05:42:29 [auto1.de] INFO: Scrape type for HD14897: 0
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for BK94674: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for WP47747: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for ZZ79893: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: HK54486
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK54486%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for HK54486: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for CU93791: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for XD58993: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: KK51592
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for PA88457: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for EN47046: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for FA01437: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for XL62342: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: YW30878
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for WS30363: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for PF96299: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for JV32404: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for GF62239: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for CC75051: 0
2026-03-28 05:42:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:31 [auto1.de] INFO: Channel: 24h | Page: 223 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for AJ85569: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for DC90555: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for YF42870: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for DZ79939: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for ND02727: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for VW56389: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for NR64586: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: CE61200
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for KR34750: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for UF21072: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for PB99961: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for ZM08692: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: US46384
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for US46384: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for ZD02189: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for VY61993: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for BP02747: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for AN93893: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for LC37503: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for MG63340: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: PZ17668
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: AY58726
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY58726%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for AY58726: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for FX88340: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for YH93335: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: EF65370
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for AH95980: 0
2026-03-28 05:42:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:33 [auto1.de] INFO: Channel: 24h | Page: 224 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for WF31302: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for AR05539: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for YM46431: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for RN03307: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for PG30420: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for NZ32972: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for TH91647: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for MF45027: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for MY29921: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for ST57334: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: ZM90265
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM90265%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for ZM90265: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for YM28187: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: XU02017
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for UD14847: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for PA85998: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for VX06464: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: EC48687
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC48687%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for EC48687: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: VC27283
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC27283%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for VC27283: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for KR59987: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: RN45636
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for BX38798: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: RT05682
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05682%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for RT05682: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: ZK76499
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for EN46705: 0
2026-03-28 05:42:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:34 [auto1.de] INFO: Channel: 24h | Page: 225 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for FZ50846: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for ZS04919: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for RM03411: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for VR34423: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: MN31316
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: BJ91996
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ91996%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for BJ91996: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for AB14083: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for HL71363: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: ZZ67378
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for GH57189: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: NB18835
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB18835%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for NB18835: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for CR29385: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for GD61504: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for LM89812: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for MC56654: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for ZE75344: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for JR97371: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for XJ62576: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for XX83628: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for DM13382: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: CC90437
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC90437%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for CC90437: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: SM08668
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM08668%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for SM08668: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: ND31150
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND31150%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for ND31150: 0
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for YB40017: 0
2026-03-28 05:42:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:35 [auto1.de] INFO: Channel: 24h | Page: 226 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: UZ74086
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-28 05:42:35 [auto1.de] INFO: Scrape type for YB62347: 0
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for UY13477: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: ML66978
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: CJ75930
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: XW49468
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for SR08314: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: MX32750
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for JS15071: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for CD13649: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: WF06816
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for HR10791: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for GS36326: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: XV66825
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: FR75488
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75488%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for FR75488: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for MD11027: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: VT63702
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63702%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for VT63702: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: SU14933
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14933%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for SU14933: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for LG62730: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: RT88012
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for JH21308: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: EU73133
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: HB31061
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB31061%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for HB31061: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for AB88110: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for GP68218: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for WZ51755: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for AE42693: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for DK89074: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for RJ96114: 0
2026-03-28 05:42:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:37 [auto1.de] INFO: Channel: 24h | Page: 227 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: NP68778
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP68778%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for NP68778: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: XS17240
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for MV46012: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for JL91815: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for PC18756: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for AY57435: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for PJ38214: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for TA14554: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: NS35673
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for HV14674: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for ZD28576: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: GD02806
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for GB27977: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for GH74073: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for SL27608: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: UR56671
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-28 05:42:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:39 [auto1.de] INFO: Channel: 24h | Page: 228 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for DV41377: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for RR95104: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for RB29698: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for TJ54274: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for BN99160: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for XN26589: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for HP95404: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for AB73354: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for SZ74678: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for RT76020: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for SA17140: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for VY78817: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: AY50267
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY50267%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for AY50267: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for HP12091: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for PB00515: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for ZE10872: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for VE44500: 0
2026-03-28 05:42:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:40 [auto1.de] INFO: Channel: 24h | Page: 229 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: KS08572
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS08572%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for KS08572: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for ZN04335: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for JR60766: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for TM66386: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for MH24339: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for KS94316: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for JR21224: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for XA59954: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for DZ93039: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for NB74696: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for LJ18760: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for VS70073: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for BV72825: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for UM48488: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for FV46397: 0
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-28 05:42:40 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Scrape type for UZ08427: 0
2026-03-28 05:42:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:41 [auto1.de] INFO: Channel: 24h | Page: 230 | totalHits: 9199 | hits on page: 39
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for SK99321: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for SG91001: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP51481%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for BP51481: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for MX26895: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for LD63966: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: PV47280
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for ME64315: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for HJ54097: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for PU13127: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for BX34768: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for SA81936: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: UY61545
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for LV52918: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for CP43977: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR29539%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for MR29539: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT64948%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for TT64948: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for FN00007: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: MD24285
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24285%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for MD24285: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: PZ15198
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: CS43081
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: VK35465
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: XB83488
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: PB97983
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97983%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for PB97983: 2
2026-03-28 05:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e35f0d5a-25a1-5724-86b4-681d3c6d14c2 with identifier: PB97983
2026-03-28 05:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35f0d5a-25a1-5724-86b4-681d3c6d14c2 with scrape type 2
2026-03-28 05:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e35f0d5a-25a1-5724-86b4-681d3c6d14c2 with scrape type 2
2026-03-28 05:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e35f0d5a-25a1-5724-86b4-681d3c6d14c2, identifier: PB97983
2026-03-28 05:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e35f0d5a-25a1-5724-86b4-681d3c6d14c2 with identifier: PB97983
2026-03-28 05:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e35f0d5a-25a1-5724-86b4-681d3c6d14c2 with identifier: PB97983
2026-03-28 05:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e35f0d5a-25a1-5724-86b4-681d3c6d14c2 with identifier: PB97983 to the API
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:23Z',
 'fuel_type': 'diesel',
 'id': 'e35f0d5a-25a1-5724-86b4-681d3c6d14c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB97983',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 177369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-02',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97983%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Saving data for PB97983: {'auction_closing_time': 1774716863.0, 'created_time': 1773945783.889507, 'last_price_update_time': 1774676562.737659}
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB97983') HTTP/1.1" 204 0
2026-03-28 05:42:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-28 05:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:43 [auto1.de] INFO: Channel: 24h | Page: 231 | totalHits: 9199 | hits on page: 0
2026-03-28 05:42:43 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 05:42:43 [auto1.de] INFO: auto1.de Batch config: batch 1/2
2026-03-28 05:42:43 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20last_price_update_time%20lt%201774244563 HTTP/1.1" 200 None
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ14734') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BA78869') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BH45536') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BY41179') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CF98938') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CG06120') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CL18387') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ49062') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK02289') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EF65265') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ83775') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FR95729') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GM58000') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GN56413') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ98212') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HE04151') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JA21775') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JH41647') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KX73244') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ81330') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LV65132') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK63509') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ML63728') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PM23650') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PP78655') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RA56298') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RD37486') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RE44331') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RY91566') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SP85984') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TA42598') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TU81473') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UH18848') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UM38574') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UM81486') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VL09647') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VU36521') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WA93170') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WT26217') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XB31619') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XE54975') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XM36053') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD10006') HTTP/1.1" 204 0
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK53589') HTTP/1.1" 204 0
2026-03-28 05:42:44 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (629 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_17_2026-03-28T05_30_00.jl
2026-03-28 05:42:44 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 814013,
 'downloader/request_count': 309,
 'downloader/request_method_count/GET': 76,
 'downloader/request_method_count/POST': 233,
 'downloader/response_bytes': 73482931,
 'downloader/response_count': 309,
 'downloader/response_status_count/200': 309,
 'dupefilter/filtered': 8,
 'elapsed_time_seconds': 757.654257,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 5, 42, 44, 468762, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 629,
 'log_count/DEBUG': 14741,
 'log_count/INFO': 19603,
 'memusage/max': 189161472,
 'memusage/startup': 147877888,
 'photo_download_count': 46,
 'request_depth_max': 234,
 'response_received_count': 263,
 'scheduler/dequeued': 309,
 'scheduler/dequeued/memory': 309,
 'scheduler/enqueued': 309,
 'scheduler/enqueued/memory': 309,
 'scrape_type/batch_skipped': 4626,
 'scrape_type/new': 14,
 'scrape_type/price_update': 615,
 'scrape_type/skipped': 3976,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 263,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.5454114237552354,
 'scrapy-zyte-api/mean_response_seconds': 2.6739118875291203,
 'scrapy-zyte-api/processed': 263,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 263,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 262,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 263,
 'scrapy-zyte-api/request_args/httpRequestBody': 233,
 'scrapy-zyte-api/request_args/httpRequestMethod': 233,
 'scrapy-zyte-api/request_args/httpResponseBody': 263,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 263,
 'scrapy-zyte-api/request_args/sessionContext': 263,
 'scrapy-zyte-api/request_args/url': 263,
 'scrapy-zyte-api/status_codes/200': 263,
 'scrapy-zyte-api/success': 263,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 9239,
 'source/total_available': 9199,
 'start_time': datetime.datetime(2026, 3, 28, 5, 30, 6, 814505, tzinfo=datetime.timezone.utc)}
2026-03-28 05:42:44 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 05:42:44 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f439e026190>
2026-03-28 05:42:44 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f439e157e10>